Method of authenticating user of electronic device, and electronic device for performing the same

ABSTRACT

An electronic device is provided. The electronic device includes one or more processors that, while the electronic device is in a locked state, control to detect whether the electronic device is lifted, in response to detecting that the electronic device is lifted, control to activate the display, obtain an image from a camera, detect a face included in the image, and perform authentication of a user based on the face being detected in the image. Based on a result of the authentication, the one or more processors switch a state of the electronic device from the locked state to an unlocked state and display an indicator for indicating that the electronic device is in the unlocked state.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation application of prior application Ser.No. 16/585,958, filed on Sep. 27, 2019, which application is acontinuation application of prior application Ser. No. 16/413,074, filedon May 15, 2019, which has issued as U.S. Pat. No. 10,433,172 on Oct. 1,2019, which is a continuation application of prior application Ser. No.15/474,212, filed on Mar. 30, 2017, which has issued as U.S. Pat. No.10,349,273 on Jul. 9, 2019, which is a continuation application of priorapplication Ser. No. 14/101,727, filed on Dec. 10, 2013, which hasissued as U.S. Pat. No. 9,652,135 on May 16, 2017, was based on andclaimed the benefit priority under 35 U.S.C § 119(a) of a Korean patentapplication number 10-2012-0143064, filed on Dec. 10, 2012, in theKorean Intellectual Property Office, of a Korean patent applicationnumber 10-2013-0001235, filed on Jan. 4, 2013, in the KoreanIntellectual Property Office, of a Korean patent application number10-2013-0001820, filed on Jan. 7, 2013, in the Korean IntellectualProperty Office, and of a Korean patent application number10-2013-0141955, filed on Nov. 21, 2013, in the Korean IntellectualProperty Office, the disclosure of each of which is incorporated byreference herein in its entirety.

TECHNICAL FIELD

The present disclosure relates to apparatuses and methods consistentwith various embodiments of a mobile device, a control method thereof,and a User Interface (UI) display method. More particularly, the presentdisclosure relates to a mobile device which is of a bangle type andoperates according to a motion thereof, a control method thereof, and aUI display method.

BACKGROUND

With the development of electronic technologies, various kinds ofelectronic apparatuses have been developed and distributed. Inparticular, as high performance parts can be microminiaturized in recentyears, the electronic apparatuses can be implemented in a small size andaccordingly mobile devices equipped with a variety of functions such asa mobile phone, a tablet PC, a laptop PC, and an MP3 player areincreasingly used.

Most of the mobile devices are put into a user's bag or pocket andcarried by the user. For example, when the mobile device is put into apocket and carried, the mobile device is likely to come out from thepocket when the user sits on a chair or lies. In the case of a light andsmall mobile device, the user may not recognize that the mobile devicecomes out from the pocket. Therefore, the risk that the user loses theuser's mobile device increases. In addition, when the mobile device iscarried in the bag or pocket along with a key or any other hard object,the mobile device may be hit by these objects when the user walks andmay be scratched or damaged.

Therefore, there is an increasing need for a method of manufacturingmobile devices in a form that is easy to carry. In addition, there is aneed for a method for controlling an operation of such a mobile deviceeasily.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below.

Accordingly, an aspect of the present disclosure is to provide a mobiledevice of a bangle type, which is worn on a user's body and is easy tocarry and use, and a control method thereof.

In accordance with an aspect of the present disclosure, a mobile deviceof a wearable bangle type is provided. The mobile device includes adisplay, a motion sensor configured to detect a motion of the mobiledevice, a storage configured to store control information which isdifferently set according to a motion state, and, when a motion isdetected by the motion sensor, a controller configured to change ascreen of the display according to control information corresponding tothe detected motion.

In accordance with an aspect of the present disclosure, when the displayis moved in a first direction while a content is being played back, thecontroller may change the screen to a previous content playback screen,and, when the display is moved in a second direction opposite to thefirst direction, the controller may change the screen to a next contentplayback screen.

In accordance with an aspect of the present disclosure, when the displayis moved in a first direction, the controller may change the screen to azoom-out screen, and, when the display is moved in a second directionopposite to the first direction, the controller may change the screen toa zoom-in screen.

In accordance with an aspect of the present disclosure, the controllermay perform at least one of operations of changing a content, zoomingin/zooming out, changing a screen arrangement direction, activating thedisplay, inactivating the display, turning off, turning on, unlocking,authenticating and selecting an application, according to the motiondetected by the motion sensor.

In accordance with an aspect of the present disclosure, when a detectingresult of the motion sensor satisfies a predetermined non-use condition,the controller may inactivate the display, and, when a detecting resultof the motion sensor satisfies a predetermined use condition, thecontroller may activate the display.

In accordance with an aspect of the present disclosure, the mobiledevice may further include a photographer disposed on the body. When adetecting result of the motion sensor satisfies a predeterminedcondition while the mobile device is a locked state, the controller maycontrol the photographer to perform photographing, and, when a user isrecognized in a photographed image, the controller may perform an unlockoperation.

In accordance with an aspect of the present disclosure, the mobiledevice may include a body which is made of a flexible material such thatthe body is wound around the user body.

In accordance with an aspect of the present disclosure, the display maybe formed on an entire surface of one side of the body.

In accordance with an aspect of the present disclosure, when one end ofthe body is unfolded while the body is worn on the user body, thecontroller may display a key pad on a display area provided on the oneend.

In accordance with an aspect of the present disclosure, the body mayinclude a first part in which the display is mounted; a second part;first protrusions spaced a predetermined distance apart from one anotheron the first part; and second protrusions formed on the second part tobe engaged with the first protrusions, and configured to support thefirst part to slide along an outer surface of the second part in phases.When the first part slides along the second part and is rotated, thecontroller may display a screen corresponding to a sliding phase.

In accordance with an aspect of the present disclosure, the display maybe disposed on an entire outer surface of the body, and the mobiledevice may further include: a cushion provided on an inner surface ofthe body; and an air driver configured to expand the cushion and bringthe cushion into close contact with the user body when the mobile deviceis worn on the user body, and, when a command to remove the mobiledevice is input, the air driver configured to contract the cushion intoan original state.

In accordance with an aspect of the present disclosure, the body may becomprised of a flexible band, and the display, the motion sensor, andthe controller may be an integrated module which is mountable in ordismountable from the body.

In accordance with another aspect of the present disclosure, a mobiledevice is provided. The mobile device includes a body of a wearablebangle type, a display disposed on at least one area of a surface of thebody and rotatable on the body, a motion sensor configured to detect arotation state of the display, a storage configured to store controlinformation which is differently set according to a rotation state, acontroller configured to change a screen of the display according tocontrol information corresponding to the rotation state detected by themotion sensor.

In accordance with another aspect of the present disclosure, a methodfor controlling a mobile device which includes a body of a bangle typeconfigured to be worn on a user body, and a display mounted in the bodyis provided. The method includes detecting a motion of the mobiledevice, and changing a screen displayed on the display according to thedetected motion.

In accordance with an aspect of the present disclosure, the changing thescreen may include, when the display is moved in a first direction whilea content is being played back, changing the screen to a previouscontent playback screen, and, when the display is moved in a seconddirection opposite to the first direction, changing the screen to a nextcontent playback screen.

In accordance with an aspect of the present disclosure, the changing thescreen may include, when the display is moved in a first direction,changing the screen to a zoom-out screen, and, when the display is movedin a second direction opposite to the first direction, changing thescreen to a zoom-in screen.

In accordance with an aspect of the present disclosure, the motion maybe at least one of a rotation motion of the display rotating around anouter circumference of the body, and a moving motion of the mobiledevice.

In accordance with an aspect of the present disclosure, the method mayfurther include performing at least one of operations of changing acontent, zooming in/zooming out, changing a screen arrangementdirection, activating the display, inactivating the display, turningoff, turning on, unlocking, authenticating and selecting an application,according to the detected motion.

In accordance with an aspect of the present disclosure, the method mayfurther include photographing, determining a user position using atleast one of a result of the photographing and a motion of the mobiledevice, and performing a control operation corresponding to thedetermined user position.

In accordance with an aspect of the present disclosure, the method mayfurther include when a motion state of the mobile device satisfies apredetermined non-use condition, inactivating the display, and, when amotion state of the mobile device satisfies a predetermined usecondition, activating the display.

In accordance with an aspect of the present disclosure, the body may bemade of a flexible material such that the body is wound around the userbody, and the display may be formed on an entire surface of one side ofthe body.

In accordance with an aspect of the present disclosure, the method mayfurther include, when one end of the body is unfolded while the body isworn on the user body, displaying a key pad on a display area providedon the one end.

In accordance with an aspect of the present disclosure, the display maybe connected to the body in such a manner that the display is slidablealong an outer circumference of the body in phases.

In accordance with an aspect of the present disclosure, the changing thescreen may include changing the screen to a screen corresponding to asliding phase of the display.

In accordance with an aspect of the present disclosure, the method mayfurther include when a command to wear the mobile device is input,expanding a cushion provided on an inner surface of the body, andbringing the cushion into close contact with the user body, and, when acommand to remove the mobile device is input, contracting the cushioninto an original state.

In accordance with another aspect of the present disclosure, a mobiledevice of a wearable bangle type is provided. The mobile device includesa storage configured to store a pre-installed application, a displayconfigured to display a list UI in which an application itemcorresponding to each application stored in the storage is arranged, anda controller configured to control the display to display an executionscreen of an application corresponding to at least one of theapplication items on a display location of the corresponding applicationitem in the list UI, and to change a display state of the list UIaccording to a user manipulation.

In accordance with another aspect of the present disclosure, a methodfor controlling a mobile device which includes a body of a bangle typeconfigured to be worn on a user body, and a display mounted in the bodyis provided. The method includes detecting a motion of the mobiledevice, and controlling operation of the mobile device according to thedetected motion.

In accordance with another aspect of the present disclosure, a methodfor displaying a UI of a mobile device, which comprises a body of awearable bangle type and a display mounted on the body is provided. Themethod includes displaying a list UI in which an application itemcorresponding to a pre-installed application is arranged, executing anapplication corresponding to at least one of the application items,displaying an execution screen of the executed application on a displaylocation of the corresponding application item in the list UI, andchanging a display state of the list UI according to a usermanipulation.

In accordance with another aspect of the present disclosure, a mobiledevice of a wearable bangle type is provided. The mobile device includesa storage, a display formed on an outer surface of the mobile deviceseamlessly and configured to display an execution screen of anapplication stored in the storage on a whole display area, a sensorconfigured to detect a user interaction, and a controller configured tochange a part of a screen displayed on a visible area of the wholedisplay area in the execution screen according to the user interaction.

In accordance with another aspect of the present disclosure, a mobiledevice of a wearable bangle type is provided. The mobile device includesa storage configured to store a pre-installed application, a sensorconfigured to detect a user interaction, a display, a controllerconfigured to display a first line UI on a first edge of a screen of thedisplay when a first user interaction is detected, and to display asecond line UI on a second edge of the screen of the display when asecond user interaction is detected.

In accordance with another aspect of the present disclosure, a methodfor displaying a UI of a mobile device of a wearable bangle type isprovided. The method includes detecting a user interaction, and when afirst user interaction is detected, displaying a first line UI on afirst edge of a screen of a display, and, when a second user interactionis detected, displaying a second line UI on a second edge of the screenof the display.

According to the various embodiments as described above, the user caneasily wear the mobile device on the user's body and easily carry themobile device.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is a view illustrating a configuration of a mobile deviceaccording to an embodiment of the present disclosure;

FIGS. 2A and 2B are views illustrating a configuration of a rotatablemobile device according to an embodiment of the present disclosure;

FIG. 3 is a view to illustrate a detailed configuration of a rotator ofa mobile device such as, for example, the mobile device of FIGS. 2A and2B according to an embodiment of the present disclosure;

FIGS. 4A, 4B, and 4C are views to illustrate an example of an operationcorresponding to rotation of a mobile device according to an embodimentof the present disclosure;

FIG. 5 is a view to illustrate a configuration of a mobile deviceaccording to an embodiment of the present disclosure;

FIGS. 6, 7, and 8 are views to illustrate examples of an operationcorresponding to a motion direction of a mobile device such as, forexample, the mobile device of FIG. 5 according to an embodiment of thepresent disclosure;

FIGS. 9A, 9B and 9C are views to illustrate an operation correspondingto a motion direction of a mobile device such as, for example, themobile device of FIG. 5 according to an embodiment of the presentdisclosure;

FIG. 10 is a view to illustrate a method for detecting a motion of amobile device according to an embodiment of the present disclosure;

FIGS. 11A, 11B, 11C, 12A, 12B, 12C, 13A, 13B, and 13C are views toillustrate various control operations of a mobile device according tovarious embodiments of the present disclosure;

FIG. 14 is a view to illustrate an operation of changing a screenarrangement direction according to a motion of a mobile device accordingto an embodiment of the present disclosure;

FIGS. 15A, 15B, and 15C are views to illustrate a method for activatinga mobile device according to a motion of the mobile device according toan embodiment of the present disclosure;

FIG. 16 is a view to illustrate a configuration of a mobile device whichfurther includes a camera to recognize a user according to an embodimentof the present disclosure;

FIGS. 17A and 17B are views to illustrate a method for recognizing auser and performing a unlock operation according to an embodiment of thepresent disclosure;

FIGS. 18A and 18B are views to illustrate an example of a passwordscreen to perform a unlock operation according to an embodiment of thepresent disclosure;

FIG. 19 is a view to illustrate a method for performing a unlockoperation according to a change in a tilt angle of a mobile deviceaccording to an embodiment of the present disclosure;

FIG. 20 is a view to illustrate examples of a rotation direction and amotion direction of a mobile device according to an embodiment of thepresent disclosure;

FIGS. 21A and 21B are views to illustrate a mobile device which isimplemented as a flexible device according to an embodiment of thepresent disclosure;

FIG. 22 is a view to illustrate an example of an operation of a mobiledevice which is implemented as a flexible device according to anembodiment of the present disclosure;

FIGS. 23A and 23B are views to illustrate an example of a configurationfor detecting a bending state of a flexible device according to anembodiment of the present disclosure;

FIG. 24 is a view illustrating an example of a cross sectionconfiguration of a mobile device such as, for example, the mobile deviceof FIGS. 21A and 21B according to an embodiment of the presentdisclosure;

FIG. 25 is a view illustrating a configuration of amountable/dismountable mobile device according to an embodiment of thepresent disclosure;

FIG. 26 is a view illustrating a configuration of a mobile device of abangle type a part of which is opened according to an embodiment of thepresent disclosure;

FIG. 27 is a view illustrating a configuration of a mobile device a partof which is opened and closed according to an embodiment of the presentdisclosure;

FIG. 28 is a view illustrating a configuration of a mobile device whichis manufactured in such a form that the mobile device can be in closecontact with a user body according to an embodiment of the presentdisclosure;

FIG. 29 is a view illustrating a configuration of a mobile device inwhich a button is provided on a side surface according to an embodimentof the present disclosure;

FIG. 30 is a flowchart to illustrate a control method of a mobile deviceaccording to an embodiment of the present disclosure;

FIG. 31 is a flowchart to illustrate a method for performing a unlockoperation according to a motion of a mobile device and a user's eyesaccording to an embodiment of the present disclosure;

FIG. 32 is a view to illustrate an overall configuration of a mobiledevice according to an embodiment of the present disclosure;

FIG. 33 is a block diagram illustrating a configuration of a mobiledevice according to an embodiment of the present disclosure;

FIGS. 34A, 34B, and 34C are views illustrating an example of aconfiguration of a list User Interface (UI) of a mobile device accordingto an embodiment of the present disclosure;

FIGS. 35A, 35B, and 35C are views illustrating a screen of a mobiledevice which provides a plurality of execution screens according to anembodiment of the present disclosure;

FIGS. 36A and 36B are views illustrating a screen configuration of amobile device according to an embodiment of the present disclosure;

FIGS. 37A and 37B are views illustrating a list UI which is displayed ona mobile device of a bangle type according to an embodiment of thepresent disclosure;

FIGS. 38A, 38B, and 38C are views illustrating a screen on which a listUI is displayed along with indicators according to an embodiment of thepresent disclosure;

FIGS. 39A and 39B are views illustrating a method for changing a displaylocation of an application item according to an embodiment of thepresent disclosure;

FIGS. 40A, 40B, 40C, 40D, and 40E are views illustrating a configurationof a mobile device according to an embodiment of the present disclosure;

FIGS. 41A and 41B are views illustrating a list UI which is generated ina form of a water drop according to an embodiment of the presentdisclosure;

FIGS. 42A, 42B, 42C, and 42D are views to illustrate a method forchanging a list UI such as, for example, the method for changing thelist UI shown in FIGS. 41A and 41B according to an embodiment of thepresent disclosure;

FIGS. 43A, 43B, 43C, and 43D are views illustrating a water drop objectwhich is enlarged and displayed according to an embodiment of thepresent disclosure;

FIGS. 44A, 44B, 44C, and 44D illustrate an example of a list UI shapeaccording to an embodiment of the present disclosure;

FIGS. 45A, 45B, and 45C are views to illustrate a process of changing alist UI according to a change of a visible area according to anembodiment of the present disclosure;

FIGS. 46A, 46B, and 46C are views illustrating a screen configurationaccording to a list UI display method according to an embodiment of thepresent disclosure;

FIGS. 47A, 47B, and 47C are views illustrating an example of a usergesture to display indicators according to an embodiment of the presentdisclosure;

FIGS. 48A and 48B are views illustrating a configuration of a list UI towhich indicators are added according to an embodiment of the presentdisclosure;

FIGS. 49A, 49B, 49C, 50A, 50B, and 50C are views to illustrate variousmethods for determining a visible area according to an embodiment of thepresent disclosure;

FIG. 51 is a flowchart to illustrate a method for displaying a UI of amobile device according to an embodiment of the present disclosure;

FIGS. 52, 53, 54, 55, 56A, 56B, and 56C are views to illustrate a UIdisplay method using a display of a seamless form according to anembodiment of the present disclosure;

FIGS. 57A and 57B are views to illustrate a method for using a runmanagement application according to an embodiment of the presentdisclosure;

FIGS. 58A, 58B, 58C, 58D, 58E, 58F, and 58G are views to illustrate amethod for using a whole execution screen of a run managementapplication according to an embodiment of the present disclosure;

FIGS. 59A, 59B and 59C illustrate change in the screen when a userlowers a mobile device while the mobile device is executing a runmanagement application according to an embodiment of the presentdisclosure;

FIGS. 60A, 60B, and 60C are views to illustrate displaying informationon the behavior of others according to an embodiment of the presentdisclosure;

FIGS. 61A, 61B, 61C, 61D, and 61E are views to illustrate a method fordisplaying a screen of a mobile device according to an embodiment of thepresent disclosure;

FIG. 62 is a view illustrating a configuration example of an executionscreen of a run management application according to an embodiment of thepresent disclosure;

FIG. 63 is a view illustrating an execution screen of a fitnessapplication according to an embodiment of the present disclosure;

FIGS. 64A, 64B, and 64C are views to illustrate a method for changing anexecution screen such as, for example, the execution screen of FIG. 63according to a user interaction according to an embodiment of thepresent disclosure;

FIGS. 65A, 65B, 65C, and 65D are views illustrating an example of a listUI in which a variety of application information including a healthapplication is displayed according to an embodiment of the presentdisclosure;

FIGS. 66A and 66B are views illustrating an example of a screen which isdisplayed while the user is exercising according to an embodiment of thepresent disclosure;

FIG. 67 is a view illustrating an example of an execution screen of amusic application according to an embodiment of the present disclosure;

FIGS. 68A, 68B, 68C, 68D, 68E, 68F, 68G, and 68H are views to illustratea method for manipulating an execution screen of a music applicationaccording to an embodiment of the present disclosure;

FIGS. 69A, 69B, 69C, and 69D are views illustrating a change example ofan execution screen according to an embodiment of the presentdisclosure;

FIGS. 70A, 70B, 70C, and 70D are views illustrating an example of ascreen manipulation method of a mobile device according to an embodimentof the present disclosure;

FIGS. 71A, 71B, and 71C are views to illustrate a method for displayinga UI according to an embodiment of the present disclosure;

FIGS. 72A, 72B, and 72C are views illustrating an example of a real UIscreen according to an embodiment of the present disclosure;

FIGS. 73A, 73B, 73C, and 73D are views to illustrate a method fordisplaying an application execution screen using a line UI according toan embodiment of the present disclosure;

FIGS. 74A, 74B, 74C, 74D, and 74E are views illustrating a process ofdisplaying a second line UI according to an embodiment of the presentdisclosure;

FIGS. 75A, 75B, 75C, and 75D are views illustrating a screenconfiguration of a mobile device according to various embodiments of thepresent disclosure; and

FIG. 76 is a flowchart to illustrate a method for displaying a UI of amobile device which provides a line UI according to an embodiment of thepresent disclosure.

The same reference numerals are used to represent the same elementsthroughout the drawings.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

In the following description, same reference numerals are used for thesame elements when they are depicted in different drawings. The mattersdefined in the description, such as detailed construction and elements,are provided to assist in a comprehensive understanding of variousembodiments. Thus, it is apparent that various embodiments can becarried out without those specifically defined matters. In addition,functions or elements known in the related art are not described indetail because such a description may obscure the various embodimentswith unnecessary detail.

FIG. 1 is a view illustrating a configuration of a mobile deviceaccording to an embodiment of the present disclosure.

Referring to FIG. 1, a mobile device 1000 includes a body 100, a display110, a controller 120, a storage 130, and a motion sensor 140.

The body 100 may be implemented in a wearable bangle type. The bangletype refers to a type that the user can wear on a part of the user'sbody, such as wrist, ankle, belly, and head. A detailed configuration ofthe body 100 will be explained below.

According to various embodiments of the present disclosure, the display110, the controller 120, the storage 130, and the motion sensor 140 aremounted in the body 100.

The motion sensor 140 is configured to detect a motion. According to anembodiment of the present disclosure, the motion sensor 140 may detect amotion of the mobile device 100, or a motion and rotation of the display110. A type of the motion or a detecting method thereof will beexplained in detail below.

The storage 130 stores control information which is differently setaccording to a motion state. The control information may include avariety of information such as an application, a control command,setting data, screen configuration data, and transition platform. Inaddition, the storage 130 may store various data such as an OperatingSystem (OS) for operating the mobile device, firmware, and applications.The storage 130 may include a non-volatile memory such as a flashmemory.

The controller 120 controls an operation of the mobile device accordingto a result of detecting of the motion sensor 140. Specifically, when amotion is detected by the motion sensor 140, the controller 120 readsout control information corresponding to the detected motion from thestorage 130. The controller 130 may control the display 110 to displayvarious screens according to the read-out control information.

As described above, the mobile device may be implemented in variousshapes. Accordingly, the controller 120 may perform a differentoperation according to a shape of the mobile device. In addition,according to an embodiment of the present disclosure, the body of themobile device itself may be moved or the body of the mobile device maybe fixed and only the display may be moved (e.g., the display of themobile device may be moved in relation to the body of the mobiledevice). When the body of the mobile device itself is moved, thecontroller 120 may detect a motion of the body and perform acorresponding operation. According to an embodiment of the presentdisclosure, in which only the display is moved, the controller 120 mayperform a corresponding operation according to a motion state of thedisplay.

Hereinafter, a shape of a mobile device and an operation thereofaccording to various embodiments will be explained.

FIGS. 2A and 2B are views illustrating a configuration of a rotatablemobile device according to an embodiment of the present disclosure. Forexample, FIGS. 2A and 2B are views illustrating a configuration of amobile device in which a body of the mobile device is fixed and adisplay is connected to the body to be slidable along the body accordingto an embodiment of the present disclosure.

Referring to FIGS. 2A and 2B, the body 100 is divided into a first part100-1 and a second part 100-2. The first part 100-1 is disposed in anouter direction of the mobile device 100, and the second part 100-2 isdisposed in an inner direction. The first part 100-1 is slidable alongan outer circumference of the second part 100-2. According to variousembodiments of the present disclosure, a connection surface between thefirst part 100-1 and the second part 100-2 is coated with materialhaving less friction, so that the first part 100-1 is slidable on (orotherwise in relation to) the second part 100-2. According to variousembodiments of the present disclosure, a space between the first part100-1 and the second part 100-2 may be filled with lubricating materialsuch as liquid or gas.

First protrusions 1, 2, 3, . . . are formed on an inner circumference ofthe first part 100-1 facing the second part 100-2 at predeterminedintervals. Second protrusions a, b, c, . . . corresponding to the firstprotrusions 1, 2, 3, . . . are formed on the second part 100-2. Thesecond protrusions a, b, c . . . are arranged to be engaged with thefirst protrusions 1, 2, 3, . . . . Although the first protrusions 1, 2,3, . . . and the second protrusions a, b, c, . . . are arranged on thewhole inner circumference of the first part and the whole outercircumference of the second part, respectively, the first protrusions 1,2, 3, . . . and the second protrusions a, b, c, . . . may be formed onparts of the inner circumference of the first part and the outercircumference of the second part.

Accordingly, the first part 100-1 is supported to be slidable along theouter circumference of the second part 100-2 in phases. For example, theuser may rotate the first part 100-1 in a first direction or a seconddirection by applying an external force to the first part 100-1.Specifically, as shown in view FIG. 2A, when one of the firstprotrusions 1 is placed between protrusions a and b of the secondprotrusions, a force may be applied to the first part 100-1 in the firstdirection. In this case, the first protrusion 1 collides with the secondprotrusion a. Accordingly, when a force greater than a predeterminevalue is applied, the first protrusion 1 goes over the second protrusiona. Accordingly, the first protrusion 2 is placed between the secondprotrusions a and b and the first part 100-1 slides in the firstdirection during the first phase, as shown in FIG. 2B.

Although the first protrusions and the second protrusions are formed ina connector between the first and second parts 100-1 and 100-2 in FIGS.2A and 2B, one of the protrusions may be replaced with a depression orany other patterns may be formed.

When the first part 100-1 slides along the second part 100-2 androtates, the controller 120 may perform an operation corresponding tothe sliding phase.

For example, when the first-phase sliding is performed in the firstdirection while an execution screen of a first application is displayed,the controller 120 may execute a second application and display anexecution screen thereof. On the other hand, when the first-phasesliding is performed in the second direction, the controller 120 mayexecute a third application and display an execution screen thereof.

The application may be executed according to various criteria such as inorder of installation, in order defined by the user, in order of name ofapplication, and/or the like. For example, when the criterion is theorder of installation, and, when rotation in the first direction isperformed, an application that is installed prior to a currentlyexecuted application is executed, and, when rotation in the seconddirection is performed, an application that is installed after a currentapplication is executed. When the criterion is the order of name, theapplications may be arranged in alphabetical order of initial sounds ofthe applications.

In addition, when the first part slides while a content is being playedback, the controller 120 may play back a previous content or a nextcontent according to a sliding direction. When sliding is performedthrough several phases at a time, the controller 120 may change aplurality of content at the same time.

FIG. 3 is a view to illustrate a detailed configuration of a rotator ofa mobile device such as, for example, the mobile device of FIGS. 2A and2B according to an embodiment of the present disclosure. For example,FIG. 3 is a view to illustrate a detailed configuration of the connector210 according to an embodiment of the present disclosure.

Referring to FIG. 3, the first protrusions 1, 2, . . . and the secondprotrusions a, b, . . . are formed in a trapezoidal shape such thattheir lateral surfaces are inclined. An elastic member such as a springmay be provided on a lower portion of at least one of the firstprotrusions 1, 2, . . . and the second protrusions a, b, . . . .

In FIG. 3, an elastic member 211 is provided in a lower space of thesecond protrusions a and b. In this case, when the first protrusionmoves to the second protrusion and collides with the second protrusion,the elastic member 211 contracts and the second protrusion movesdownwardly. Accordingly, the first protrusion goes over the secondprotrusion.

The motion sensor 140 counts a number of collisions between the firstprotrusions and the second protrusions, calculates the sliding phase,and notifies the controller 120 of the number of collisions between thefirst protrusion and the second protrusion, or of the sliding phase. Forexample, the elastic member 211 may be implemented by using a straingage. The strain gage may be made of metal or semiconductor whichgreatly changes a resistance value according to a magnitude of anapplied force. For example, when a compressive force is applied, theresistance value is reduced. When the resistance value of the elasticmember 211 provided in the second protrusion is reduced, the motionsensor 140 may detect that the first-phase sliding is performed.

According to various embodiments of the present disclosure, the display110 may be disposed on the entire outer circumference of the first part100-1. According to various embodiments of the present disclosure, thedisplay 110 may be disposed on a part of the outer circumference of thefirst part 100-1. In addition, a plurality of displays may be arrangedon the body of the mobile device side by side. In this case, whenrotation is performed, screens displayed on the display are changed fromone to another according to a rotation state.

FIGS. 4A, 4B, and 4C are views to illustrate an example of an operationcorresponding to rotation of a mobile device according to an embodimentof the present disclosure. For example, FIGS. 4A, 4B, and 4C illustratea display which is disposed on the entire outer circumference accordingto an embodiment of the present disclosure.

Referring to FIGS. 4A to 4C, the display 110 is disposed enclosing theouter circumference of the body 100. Accordingly, various screens aredisplayed along the entire outer circumference of the mobile device ofthe bangle type as shown in FIGS. 4A, 4B, and 4C.

The body 100 may be rotatable as shown in FIGS. 2A, 2B, and 3. In thiscase, the user may rotate the display 110 in the first direction or thesecond direction manually. The screen may be changed to a previousscreen or a next screen according to a rotation direction as shown inFIGS. 4B and 4C.

Although the screen is changed by rotating the display in theembodiments of the present disclosure illustrated in FIGS. 2A to 4C, theoperation may be controlled by rotating the body of the mobile device.Hereinafter, an embodiment of the present disclosure in which anoperation is controlled according to a motion of the mobile device willbe explained.

FIG. 5 is a view to illustrate a configuration of a mobile deviceaccording to an embodiment of the present disclosure.

Referring to FIG. 5, the display 110 is disposed on a part of the outercircumference of the body 100. However, the display 110 may be formed onthe entire outer circumference as shown in FIG. 4.

As illustrated in FIG. 5, the mobile device 1000 may be implemented insuch a form that the user can wear the mobile device 1000 around theuser's wrist. The user may make various kinds of gestures such asraising the user's arm or flicking or rotating the user's wrist whilewearing the mobile device around the user's wrist.

FIGS. 6, 7, and 8 are views to illustrate examples of an operationcorresponding to a motion direction of a mobile device such as, forexample, the mobile device of FIG. 5 according to an embodiment of thepresent disclosure.

For example, FIGS. 6 and 7 are views to illustrate an operation of amobile device which is controlled according to a user gesture accordingto an embodiment of the present disclosure.

Referring to FIG. 6, the user may make a gesture of flicking in a firstdirection while wearing the mobile device around the user's wrist. Theflicking gesture refers to a gesture of moving the mobile device quicklyin one direction, holding the mobile device, and then returning themobile device to an original state thereof

When such a gesture is recognized, the controller 120 changes a screendisplayed on the display 110. For example, when a motion in the firstdirection is detected while screen 2 is displayed, screen 1 which is aprevious screen is displayed.

In contrast, when the user makes a gesture of flicking in a seconddirection as shown in FIG. 7, screen 3 which is a next screen isdisplayed.

The controller 120 may skip over a plurality of phases according to adegree of flicking operation, and, when the user holds the flickingoperation without returning to the original state, the controller 120may continue to change the screen.

FIG. 8 illustrates a case in which the user makes a gesture of rotatingthe user's wrist while wearing the mobile device according to anembodiment of the present disclosure.

Referring to FIG. 8, when screen 1 is displayed on the display 110, theuser may rotate the mobile device by twisting the user's wrist. In thisstate, when the user returns the mobile device to an original statethereof after a predetermined time (‘a’ second) elapses, the screen ischanged during that time and screen n is displayed. Although not shownin the drawing, a different screen may be displayed by rotating themobile device in the opposite direction to that illustrated in FIG. 8.

In addition, besides the screen changing operation, other operationssuch as an editing operation may be performed according to a motion ofthe mobile device.

FIGS. 9A, 9B and 9C are views to illustrate an operation correspondingto a motion direction of a mobile device such as, for example, themobile device of FIG. 5 according to an embodiment of the presentdisclosure.

For example, FIGS. 9A, 9B and 9C are views to illustrate an editingoperation of the mobile device according to an embodiment of the presentdisclosure.

Referring to FIG. 9A, 9B, and 9C, the display 110 of the mobile devicedisplays a screen (APP2) including an object 111 such as an image, atext, a photo, and/or the like.

In this state, when the user makes a gesture of flicking the user'swrist in the first direction or second direction, the screen is changedaccording to the moving direction. For example, as illustrated in FIG.9B, when a gesture in the first direction is made, the screen is changedto a screen APP1 which is a previous screen of the current screen APP2,and the object 111 is moved to the screen APP1. When the mobile devicereturns to the original position thereof, the screen APP1 including theobject 111 is displayed.

In contrast, as illustrated in FIG. 9C, when a gesture in the seconddirection is made, the screen is changed to a screen APP3 which is anext screen of the current screen APP2. Accordingly, the object 111 isdisplayed on the screen APP3.

According to various embodiments of the present disclosure, the object111 may include various kinds of objects such as photos, images, texts,and/or the like. In order to move the display of the object, anoperation of specifying the object may be performed first. For example,the user may change the object display screen by specifying the object111 by touching the object 111 and then flicking the user's wrist in thefirst direction or the second direction. The touch may include variouskinds of touch operations such as a simple touch, a long touch, a doubletouch, and/or the like. When the user touches the object 111, thecontroller 120 fixes the touched object 111 and changes a backgroundscreen to a previous screen or a next screen.

According to various embodiments of the present disclosure, when theuser photographs an image in the mobile device using a photographingprogram or when the user generates a text or an image through a notepad,a document creating program, or a paint, the photographed image or thetext or image generated by the corresponding task may be directlyutilized in a specific application. For example, by making a gesture inthe first direction or second direction while the object such as thephotographed image or text or image is displayed, an application towhich the generated object is applied may be selected. For example, whena gesture in the first direction is made, a program for managing astored still image or moving image content may be executed and thecorresponding object may be stored. In addition, when a gesture in thesecond direction is made, an e-mail program may be executed and an emailto which the corresponding object is attached may be generated.

According to various embodiments of the present disclosure, to detectthe user gesture described above, the motion sensor 140 may furtherinclude an acceleration sensor, a geomagnetic sensor, a gyro sensor,and/or the like.

FIG. 10 is a view to illustrate an example of a method for detecting amotion in a mobile device according to an embodiment of the presentdisclosure.

Referring to FIG. 10, the motion sensor 140 is mounted in the body 100and detects a motion of the mobile device.

According to various embodiments of the present disclosure, when themotion sensor 140 is provided in the mobile device, X, Y, and Z-axes,which are orthogonal to one another, are determined according to aplacement direction of the motion sensor 140. A pitch angle refers to arotation angle that is measured when the mobile device is rotated aboutthe Y-axis, and a roll angle refers to a rotation angle that is measuredwhen the mobile device is rotated about the X-axis. A yaw angle refersto a rotation angle that is measured when the mobile device is rotatedabout the Z-axis. The pitch angle and the roll angle are measured by theacceleration sensor, and the yaw angle is measured by the geomagneticsensor or gyro sensor.

According to various embodiments of the present disclosure, theacceleration sensor and the geomagnetic sensor may include a 2-axisfluxgate or a 3-axis fluxgate. However, to manufacture a thin mobiledevice, the acceleration sensor and the geomagnetic sensor may be madeof the 2-axis fluxgate.

The controller 120 may calculate the pitch angle, roll angle, and yawangle based on output values of the acceleration sensor and thegeomagnetic sensor, and may determine a user gesture according to aresulting value of the calculation.

According to various embodiments of the present disclosure, thecontroller 120 may normalize the output values of the X-axis and Y-axisacceleration sensors to map them onto output values of a predeterminedrange. For example, the normalizing process may be performed usingEquation 1:

$\begin{matrix}{{{Xt}_{norm} = \frac{{2{Xt}} - \left( {{Xt_{\max}} + {Xt_{\min}}} \right)}{{Xt}_{\max} - {Xt}_{\min}}}{{Yt}_{norm} = \frac{{2Yt} - \left( {{Yt}_{\max} + {Yt}_{\min}} \right)}{{YT}_{\max} - {Yt}_{\min}}}} & {{Equation}\mspace{20mu} 1}\end{matrix}$

where Xt is an output value of the X-axis accleration sensor, Yt is anoutput value of the Y-axis accleration sensor, Xt_(norm) is a normlizedoutput value of the X-axis accleration sensor, and Yt_(norm) is anormalized output value of the Y-axis accleration sensor.

When the normalizing is performed, the controller 120 may calculate apitch angle (θ) and a roll angle (φ) using Equation 2:

$\begin{matrix}{{\theta = {\sin^{- 1}\left( {Xt_{norm}} \right)}}{\phi = {\sin^{- 1}\left( \frac{{Yt}_{norm}}{\cos\;\theta} \right)}}} & {{Equation}\mspace{20mu} 2}\end{matrix}$

where Xt_(norm) is a normalized output value of the X-axis accelerationsensor, Yt_(norm) is a normalized output value of the Y-axisacceleration sensor, θ is a pitch angle, and φ is a roll angle.

In contrast, according to various embodiments of the present disclosure,the geomagnetic sensor may be implemented in a configuration similar tothat of the acceleration sensor. First, the controller 120 may normalizethe output values of the X-axis and Y-axis fluxgates in the geomagneticsensor using Equation 3:

$\begin{matrix}{{{Xf}_{norm} = \frac{\left( {{Xf} - {Xf}_{bias}} \right)}{{Xf}_{sf}}}{{{Yf}_{norm} = {{\frac{\left( {{Yf} - {Yf}_{bias}} \right)}{{Yf}_{sf}}*_{\alpha}{Xf}_{bias}} = \frac{{Xf}_{\max} + {Xf}_{\min}}{2}}},\mspace{14mu}{{Xf}_{sf} = \frac{{Xf}_{\max} - {Xf}_{\min}}{2}}}{{{Yf}_{bias} = \frac{{Yf}_{\max} + {Yf}_{\min}}{2}},\mspace{14mu}{{Yf}_{sf} = \frac{{Yf}_{\max} - {Yf}_{\min}}{2}}}} & {{Equation}\mspace{20mu} 3}\end{matrix}$

where Xf and Yf are real output values of the X-axis and Y-axisgeomagnetic sensors, respectively, Xf_(norm) and Yf_(norm) arenormalized values of the X-axis and Y-axis, Xf_(max) and Xf_(min) are amaximum value and a minimum value of Xf, and Yf_(max) and Yf_(min) are amaximum value and a minimum value of Yf. Although not shown in Equation3, each of the normalized values may further be multiplied by apredetermined constant.

The controller 120 may calculate a direction in which the motion sensor140 is placed in a 3-dimensional space, for example, azimuth, using thenormalized values. The azimuth is a 3-dimensional space value that isrepresented by three axes, and thus an output value of the Z-axis whichis perpendicular to the plane formed by the X-axis and Y-axis isrequired to calculate the azimuth. However, because the output value ofthe Z-axis cannot be directly calculated in the 2-axis fluxgate, theoutput value of the Z-axis should be calculated virtually. Thecontroller 120 may calculate a virtually normalized output value of theZ-axis by assigning the normalized output values of the X-axis andY-axis, the pitch angle, the roll angle, and the yaw angle usingEquation 4:

$\begin{matrix}{{Zf_{norm}} = \frac{\left( {{{Xf}_{norm}*\sin\;\theta} - {{Yf}_{norm}*\cos\;\theta*\sin\;\phi} + {\sin\;\lambda}} \right)}{\cos\;\theta*\cos\;\phi}} & {{Equation}\mspace{20mu} 4}\end{matrix}$

where Zf is a virtual voltage value of the Z-axis, Zf_(norm) is anormalzied value of the Z-axis voltage value, λ is a yaw angle, θ is apitch angle, and φ is a roll angle.

When the normalized value of the virtual Z-axis voltage value iscalculated in this way, azimuth is finally calculated using Equation 5:

$\begin{matrix}{\alpha = {\tan^{- 1}\left( \frac{{{Zf}_{norm}*\sin\;\phi} - {{Yf}_{norm}*\cos\;\phi}}{\begin{matrix}{{{Xf}_{norm}*\cos\;\theta} + {{Yf}_{norm}*\sin\;\theta*\sin\;\phi} +} \\{{Zf}_{norm}*\sin\;\theta*\cos\;\phi}\end{matrix}} \right)}} & {{Equation}\mspace{20mu} 5}\end{matrix}$

where α is azimuth, Xf_(norm), Yf_(norm), and Zf_(norm) are normalizedoutput values of the X-axis, Y-axis, and Z-axis fluxgates, respectively,θ is a pitch angle, φ is a roll angle, and λ is a yaw angle.

The controller 120 may calculate the yaw angle by comparing the azimuthcalculated using the geomagnetic sensor and previously calculatedazimuth. For example, when the previous azimuth is a and the currentazimuth is α+30, the controller 120 may determined that the mobiledevice is rotated by 30 degrees in a clockwise direction. In addition,the controller 120 may determine which direction the mobile device isplaced in and how much the mobile device is tilted according to a changein the pitch angle or roll angle calculated by the acceleration sensor.

When the user wears the mobile device around the user's wrist, andraises the user's arm and looks at the mobile device, the plane formedby the X-axis and the Y-axis is maintained parallel with the surface ofthe earth as shown in FIG. 10. In this state, when the user makes agesture of flicking, equilibrium is maintained in the X-axis and Y-axisdirections and rotation is performed about the Z-axis. Therefore, theyaw angle is changed. The flicking gesture is different from a simplemoving gesture in that the flicking gesture accelerates, abruptly stops,and then returns to an original position thereof. The controller 120 maydetermine whether the geture acclerates or not by counting a time fromwhen a motion is detected by the motion sensor 140 to when the motion isstopped. As described above, the controller 120 may determine whetherthe flicking gesture is made or not based on a change in the yaw angleand a time during which the yaw angle is changed.

In addition, when the user makes a gesture of rotating the user's wrist,rotation is performed about the X-axis. Accoridngly, the controller 120may determine whether the user makes the gesture of rotating the user'swrist or not based on a change in the pitch angle and a time duringwhich the picth angle is changed.

In addition, when the user lowers the user's arm in a palm downdirection or when the user raises the user's arm to look the display110, the rotation is performed about the Y-axis. Thereofre, thecontroller 120 may determine whether the user raises or lowers theuser's arm based on a change in the roll angle and a time during whichthe roll angle is changed.

According to an embodiment of the present disclosure, the motion sensormay be impelented in various forms. For example, when the mobile deviceis configured as shown in FIGS. 2A, 2B, and 3, the motion sensor maydetect a rotation direction and a degree of rotation according to arelative rotation between the first part and the second part. In thisconfiguration, the motion sensor may include a geomagnetic sensor, agyro sensor, an acceleraiton sensor, and/or the like.

According to various embodiments of the present disclosure, the motionsensor may include a geomagentic sensor, a gyro sensor, and anacceleration sesor as described in FIG. 10. In this case, even when thebody 100 is formed in an integrated configuration rather than a two-partconfiguration as shown in FIGS. 2A, 2B, and 3, various motions such asrotation or movement may be detected.

As described above, the mobile device is rotatable and movable invarious directions, and the controller 120 may detect the rotation ormovement and may perform various operations according to an exempalryembodiment.

FIGS. 11A, 11B, 11C, 12A, 12B, 12C, 13A, 13B, and 13C are views toillustrate various control operations of a mobile device according tovarious embodiments of the present disclosure.

For example, FIGS. 11A, 11B, 11C, 12A, 12B, 12C, 13A, 13B, and 13C areviews to illustrate examples of an operation performed according to amotion of the mobile device according to an embodiment of the presentdisclosure.

Referring to FIGS. 11A, 11B, and 11C, a case in which a motion is madewhile a content is being played back is illustrated. When the mobiledevice is moved while a content is being played back, a screen ischanged according to a direction of the motion. For example, when amotion in a first direction is detected while a single content playbackscreen (content 2) is being displayed as shown in FIG. 11B, thecontroller 120 plays back content 1 which is placed before content 2 ina content arrangment order. Accordingly, as shown in FIG. 11A, thecontent playback screen is changed to a previous content playback screen(content 1).

In contrast, when the mobile device is moved in a second directionopposite to the first direction, a next content (content 3) is playedback and the content playback screen is changed to a next contentplayback screen as shown in FIG. 11C.

According to various embodiments of the present disclosure, the contentmay be content that is stored in the storage 130, or may be content thatis provided from a server apparatus connected through a network.

According to various embodiments of the present disclosure, the contentplaying back operation may be changed instead of the content. Forexample, when the mobile device is moved in the first direction,rewinding may be performed, and, when the mobile device is moved in thesecond direction, fast forwarding may be performed.

According to various embodiments of the present disclosure, the contentmay include a variety of content such as a moving image content, a musiccontent, a photo content, an e-book content, and/or the like.

Referring to FIGS. 12A, 12B, and 12C, a control operation performedwhile a photo content is being displayed is illustrated. As illustratedin FIGS. 12A to 12C, a screen is changed to a previous photo screen or anext photo screen according to a motion direction of the mobile device.

Referring to FIGS. 13A, 13B, and 13C, a case in which a zoom-inoperation and a zoom-out operation are performed is illustrated. Asillustrated in FIG. 13B, when the mobile device is moved in the firstdirection while a still image such as a photo or a map is beingdisplayed, zooming-out is performed. Accordingly, a screen is changed toa zoom-out screen as illustrated in FIG. 13A. In contrast, asillustrated in FIG. 13C, when the mobile device is moved in the seconddirection, zooming-in is performed and the screen is changed to azoom-in screen.

According to various embodiments of the present disclosure, thecontroller 120 may change a screen arrangement direction according to amotion of the mobile device.

FIG. 14 is a view to illustrate an operation of changing a screenarrangement direction according to a motion of a mobile device accordingto an embodiment of the present disclosure.

Referring to FIG. 14, in a position in which the user raises the user'sright hand while wearing a mobile device 1000 around the user's rightwrist, and sees a display 110 of the mobile device 1000, the width ofthe display screen is seen as being greater than the height.Accordingly, the screen is placed in a horizontal direction as shown inFIG. 14. In this state, when the user unfolds the user's right arm, therotation is performed with reference to the Z-axis from among the X, Y,and Z-axis of FIG. 10. For example, when the user unfolds the user'sright arm, the yaw angle is changed. The controller 120 changes thescreen direction when the yaw angle is changed more than a predeterminedthreshold. Accordingly, the screen is placed in a vertical direction.

According to various embodiments of the present disclosure as describedabove, the controller 120 may change the screen to a screen that is easyto see according to a position of the user, and may display the screen.

According to various embodiments of the present disclosure, thecontroller 120 may perform activating or inactivating according to amotion of the mobile device. The inactivating refers to an operation ofturning off backlight of the display 110 or displaying a power savingscreen or other monochrome screens. Alternatively, the inactivating mayrefer to a lock state. The activating refers to an operation ofreturning to the original screen from such an inactivation state.Alternatively, the activating may refer to a unlock state.

FIGS. 15A, 15B, and 15C are views to illustrate an operation performedaccording to a motion of a mobile device according to an embodiment ofthe present disclosure.

For example, FIGS. 15A, 15B, and 15C are views to illustrate anoperation performed according to a motion of the mobile device and achange in a user's position according to an embodiment of the presentdisclosure.

Referring to FIGS. 15A, 15B, and 15C, the controller 120 compares amotion state detected by the motion sensor 130 and a conditionpre-stored in the storage 130. The condition includes various stateconditions such as a pitch angle, a roll angle, a yaw angle, rotationinformation, and a moving time, which are detected by the motion sensor140. The condition may be divided into a use condition and a non-usecondition. A manufacturer of the mobile device or a content creator maymake a plurality of test subjects wear the mobile device, may calculatedetecting results of the motion sensor 140, which are measured when themobile device is in use and when the mobile device is not in use, mayset the calculated values as a use condition or a non-use condition, andmay store the values.

When the mobile device (e.g., the controller 120) determines that thenon-use condition is satisfied, the controller 120 may inactivate thedisplay 110. When the mobile device (e.g., the controller 120)determines that a detecting result of the motion sensor 140 satisfies apredetermined use condition, the controller 120 may activate the display110.

When the user lowers the user's arm while wearing the mobile device 1000around the user's wrist as illustrated in FIG. 15A, the controller 120inactivates the display 110. In this state, when the user raises theuser's arm as illustrated in FIG. 15B, the controller 120 detects user'seyes. When the mobile device (e.g., the controller 120) determines thatthe user sees the mobile device as shown in FIG. 15C, the controller 120activates the display 110. According to various embodiments of thepresent disclosure, to detect the user's eyes, the mobile device mayfurther include a photographer such as a camera.

FIG. 16 is a view to illustrate a configuration of a mobile device whichfurther includes a camera to recognize a user according to an embodimentof the present disclosure.

Referring to FIG. 16, the mobile device 100 includes a photographer 150(e.g., a camera) provided on one side of the display 110. Thephotographer 150 may include a lens and an image sensor. Ageneral-purpose lens, a wide-angle lens, a zoom lens, and the like maybe used in the photographer 150. The kind of lens used in thephotographer 150 may be determined according to a kind of a mobiledevice and a characteristic, and a use environment. The image sensorincludes a Complementary Metal Oxide Semiconductor (CMOS) and a ChargeCoupled Device (CCD). According to various embodiments of the presentdisclosure, when the mobile device is rotatable as shown in FIGS. 2A,2B, and 3, the photographer 150 may be disposed on a side surface of thesecond part 100-2 so that the location of the photographer 150 can bemaintained even when the mobile device is rotated.

Although only a single photographer is provided in FIG. 16, according tovarious embodiments of the present disclosure, a plurality ofphotographers may be provided. In addition, locations of thephotographers may be determined variously.

FIGS. 17A and 17B are views to illustrate a method for recognizing auser and performing a unlock operation according to an embodiment of thepresent disclosure.

For example, FIGS. 17A and 17B are views to illustrate a process ofperforming a unlock operation using a photographed image according to anembodiment of the present disclosure.

According to various embodiments of the present disclosure, thecontroller 120 determines whether a detecting result of the motionsensor 140 satisfies a predetermined condition or not while the mobiledevice is locked. The predetermined condition may be a use conditionsuch as information on a pitch angle, a roll angle, and a yaw anglewhich are measured when the user raises the user's arm to see the mobiledevice as shown in FIG. 15B, and a holding time of the user gesture. Forexample, when the pitch angle, the roll angle, the yaw angle, and/or thelike satisfy a condition stored in the storage 130 for a predeterminedtime, the controller 120 determines that the user moves the mobiledevice to a position at which use of the mobile device is easy. Then,the controller 120 may control the photographer 150 to photograph animage.

Referring to FIG. 17A, the display 110 displays a photographed image1710. The controller 120 analyzes the photographed image and recognizesa characteristic of the image. For example, the controller 120 mayrecognize a user's eyes or a user's face. Specifically, the controller120 divides the photographed image 1710 into a plurality of pixelblocks. The controller 120 calculates an average of pixel values ofpixels included in each pixel block and sets the average as arepresentative value of the corresponding pixel block. The controller120 selects the pixel blocks one by one in sequence from the uppercorner of the leftmost side in a right line direction and compares arepresentative value of the selected pixel block and representativevalues of the adjacent pixel blocks, and repeats this operation. When adifference between the representative values is greater than or equal toa predetermined threshold, the controller 120 may determine thecorresponding pixel block as a pixel block corresponding to an edge. Byperforming this operation, the controller 120 groups the pixel blockshaving similar pixel values from among the pixel blocks divided withreference to the edge, and recognizes the grouped pixel blocks as asingle object.

The controller 120 searches for an object that has informationcorresponding to information registered in the storage 130 from amongthe recognized objects. When a pixel block group having pixel valuescorresponding to predetermined face color is searched, the controller120 may recognize the pixel block group as a user face.

Referring to FIGS. 17A and 17B, when the user face is recognized asillustrated in FIG. 17A and the recognized face is determined as analready registered user face, the controller 120 performs unlocking, anddisplays a desktop screen 1720 or a final screen displayed when theunlocking operation is performed, as illustrated in FIG. 17B.

Although the user face is photographed and the unlocking is performed inFIG. 17, according to various embodiments of the present disclosure, theunlocking may be performed using a password screen.

FIGS. 18A and 18B are views to illustrate an example of a passwordscreen to perform a unlock operation according to an embodiment of thepresent disclosure.

Referring to FIGS. 18A and 18B, an operation of the mobile device whichperforms unlocking using a password according to an embodiment of thepresent disclosure is illustrated. When the motion of the mobile device1000 satisfies the use condition as shown in FIG. 15, the controller 120displays a password input screen 1800 as illustrated in FIG. 18A. Thepassword input screen 1800 may be comprised of a plurality of linesaccording to a shape of the mobile device of the bangle type like ananalogue dial. The user inputs a password in a password input area 1810by scrolling each line in a touch and drag method. When a determinedpassword is input, the password input screen 1800 is changed and theunlocking operation is performed as shown in FIG. 18B. Accordingly, adesktop screen or a final screen is displayed.

In the above-described various embodiments of the present disclosure,the controller 120 is operated when the motion detected by the motionsensor 140 satisfies the predetermined use condition. However, accordingto various embodiments of the present disclosure, the controller 120 maystart to be operated when the motion is held for a predetermined timewithout satisfying a separate use condition.

FIG. 19 is a view to illustrate a method for performing a unlockoperation according to a change in a tilt angle of a mobile deviceaccording to an embodiment of the present disclosure.

For example, FIG. 19 is a view to illustrate a method for performing acontrol operation according to a motion state according to an embodimentof the present disclosure.

Referring to FIG. 19, the output value of the motion sensor 140 that hasbeen frequently changed is maintained within a predetermined range whenthe user fixes the user's position. As illustrated in FIG. 19, when theoutput value detected by the motion sensor 140 is maintained for apredetermined time, the controller 120 performs a unlock operation atthat time.

In addition, diverse motions of the mobile device may be measuredaccording to shapes of the motion sensor 140. FIG. 20 illustratesexamples of the motion of the mobile device according to an embodimentof the present disclosure.

FIG. 20 is a view to illustrate examples of a rotation direction and amotion direction of a mobile device according to an embodiment of thepresent disclosure.

Referring to FIG. 20, the mobile device 1000 may be rotated in a (+)direction or (−) direction while the mobile device 1000 is worn aroundthe user's wrist. In addition, the mobile device 1000 may be moved invarious directions such as directions (1) to (4). To detect the rotationin the (+) or (−) direction, the body 100 of the mobile device may beconfigured as illustrated in FIGS. 2A, 2B, and 3. In addition, themobile device may be configured to include a geomagnetic sensor or agyro sensor and an acceleration sensor to detect the movement in thedirections (1) to (4) as well as the rotation in the (+) or (−)direction as illustrated in FIG. 10.

The controller 120 may detect diverse motions of the mobile device suchas a shaking pattern, a movement order, a rhythm, and a direction usingthe motion sensor 140. When a different function matches each of thesemotions and is stored in the storage 130, the controller 120 performs afunction matching a detected motion.

When the mobile device further includes the photographer as shown inFIG. 16, the controller 120 may determine a user position by combining adetecting result of the motion sensor 140 and a photographing result ofthe photographer 150. For example, when the motion detected by themotion sensor 140 satisfies the use condition, the controller 120controls the photographer 150 to photograph an image. The controller 120analyzes the photographed image and detects a location of the user'sface or eyes. When it is determined that the user face is not detectedor the user's eyes are not on the mobile device, the controller 120 maymaintain a previous state without performing a separate controloperation. For example, when the mobile device is in the lock state, thecontroller 120 may maintain the lock state without unlocking. Incontrast, when the user's face or eyes are detected, the controller 120may perform various control operations as describe above.

In the above-described various embodiments of the present disclosure,the user's position is determined using the photographing operation andthe motion detecting operation. However, the user's position may berecognized by detecting a muscular movement of the user other than usingthe photographing operation. For example, according to variousembodiments of the present disclosure, the mobile device may include anElectromyogram (EMG) sensor disposed on a part of the innercircumference of the body of the mobile device that is directly incontact with the user's body. The controller 120 recognizes a change inthe user's position based on a detecting value output from the EMGsensor, and performs a control operation corresponding to the recognizedchange in the position.

According to various embodiments of the present disclosure, the mobiledevice may further include a light sensor. In this case, the controller120 may measure brightness using the light sensor and may automaticallydetermine whether to display information according to the brightness.For example, when the measured brightness is higher than predeterminedilluminance, the mobile device may display information, and, when thebrightness is low, the mobile device may not display information. Inaddition, when the brightness is low, the mobile device may display acaution screen and may prevent an accident.

When the mobile device is implemented in a bangle type such that themobile device can be worn around the user's wrist as described above,the mobile device may perform various functions which are set accordingto a position or a direction of the wrist, a speed and a direction of agesture, a number of times that rotation is input, a direction ofrotation input, an intensity of rotation input, and information onwhether rotation input is retained or not.

For example, when the user unfolds the user's arm and moves quickly orirregularly, the mobile device may turn off a screen. In contrast, whenthe user moves slowly or when the mobile device is determined to havebeen placed where the user can see the mobile device in a still state,the mobile device may display a screen.

According to various embodiments of the present disclosure, when theuser lowers the user's arm, the mobile device may change a mode to astandby mode, and, when the user raises the user's arm to middle heightas if the user looks a watch, the mobile device may perform a unlockoperation. In this case, the mobile device may perform the unlockoperation more safely by displaying a face recognition screen or aunlock pattern.

According to various embodiments of the present disclosure, when theuser raises the user's arm higher than the user's eyes, the mobiledevice may perform various operations such as executing an applicationthrough face recognition, entering a standby mode, automatically playingback a content, text auto scroll, and the like.

The mobile device may be implemented in various shapes. Hereinafter,shapes of the mobile device according to various exemplary embodimentsof the present disclosure will be explained.

FIGS. 21A and 21B are views to illustrate a mobile device which isimplemented as a flexible device according to an embodiment of thepresent disclosure.

Referring to FIG. 21, a body of the mobile device may be made offlexible material such that the mobile device can be wound around auser's body.

In this case, a display 110 may be formed on an entire surface of oneside of the body 100. The display 110 may also be made of flexiblematerial such that the display 110 can be bent along with the body 100.For example, the mobile device 1000 is manufactured in a flat state asshown in FIG. 21A. The user places the mobile device 1000 on the user'sbody such as a wrist, and bends and winds the mobile device 1000 aroundthe wrist as shown in FIG. 21B.

According to various embodiments of the present disclosure, when themobile device 1000 is in the flat state, the controller 120 mayinactivate various elements. According to various embodiments of thepresent disclosure, when the mobile device 1000 is bent as shown in FIG.21, the controller 120 may activate the elements.

When one end of the body 100 is unfolded with the body 100 being incontact with the user's body, the controller 120 may display a key padon a display area provided on the one end of the body 100.

FIG. 22 is a view to illustrate an example of an operation of a mobiledevice which is implemented as a flexible device according to anembodiment of the present disclosure.

For example, FIG. 22 illustrates one end of the body 100 which isunfolded according to an embodiment of the present disclosure.

Referring to FIG. 22, in general, the user may control an operationusing a touch or motion while wearing the mobile device around theuser's wrist. In this case, when the user needs to input varioussymbols, characters, or numbers to send a message or a mail as in amessenger or a document creating program, one end of the body 100 may beunfolded as shown in FIG. 22. In this case, a key pad 2100 is displayedon the unfolded area. The user may use the mobile device 1000 bytouching keys matching symbols, characters, numbers, or various commandson the key pad 2100.

FIGS. 23A and 23B are views to illustrate an example of a configurationfor detecting a bending state of a flexible device according to anembodiment of the present disclosure.

For example, FIGS. 23A and 23B are views to illustrate a mobile devicewhich is implemented as a flexible device according to an embodiment ofthe present disclosure.

Referring to FIG. 23A, a plurality of bend sensors 2210, 2220, 2230,2240, and 2250 may be provided in the mobile device 1000. The bendsensors 2210, 2220, 2230, 2240, and 2250 may be implemented by usingstrain gages or piezoelectric sensors as described above.

Accordingly, when the mobile device 1000 is bent in a bangle shape asillustrated in FIG. 23B, each of the bend sensors 2210 to 2250 detectsbending. When the bending is detected, the controller 120 may activatethe various elements including the display 110. In this case, thedisplay 110 and the body 110 may be implemented as one body.

FIG. 24 is a view illustrating an example of a cross sectionconfiguration of a mobile device such as, for example, the mobile deviceof FIGS. 21A and 21B according to an embodiment of the presentdisclosure.

For example, FIG. 24 is a view illustrating an example of a crosssection configuration of the display 110 according to an embodiment ofthe present disclosure.

Referring to FIG. 24, the display 110 includes a protection layer 2410,a display panel 2420, a driver 2430, and a substrate 2440.

The protection layer 2410 is formed on a surface of the display panel2420 to protect the display panel 2420. The protection layer 2410 may bemade of transparent silicon or transparent polymer material. The displaypanel 2420 may be implemented by using various kinds of panels asdescribed above. The display panel may be implemented by using a LiquidCrystal Display (LCD), an Organic Light Emitting Diode (OLED), anElectrophoretic Display (EPD), an Electrochromic Display (ECD), a PlasmaDisplay Panel (PDP), and/or the like. The driver 2430 has a drivingcircuit mounted therein to drive the display panel. Specifically, thedriving circuit may include a transistor such as an a-si Thin FilmTransistor (TFT), a Low Temperature Poly Silicon (LTPS) TFT, an OrganicTFT (OTFT), and/or the like. When an electric signal is applied, thetransistor makes a corresponding pixel cell in the display panel emitlight. Accordingly, an image may be displayed on the display panel. Likethe protection layer 2410, the substrate 2440 may be made of flexiblematerial such as transparent silicone or transparent polymer.

The display panel 2420 may be provided with a touch sensor. The touchsensor may be implemented by using a capacitive type or a resistive typeof sensor. The capacitive type calculates touch coordinates by detectingminute electricity excited in a user's body when a part of the user'sbody touches the surface of the display 110, using a dielectricsubstance coated on the surface of the display 110. The resistive typeincludes two electrode plates embedded in the display 110, and, when theuser touches a screen, calculates touch coordinates by detecting anelectric current flowing due to contact between upper and lower platesat the touched point. As described above, the touch sensor may beembodied in various forms.

The controller 120 may detect a user touch on the surface of the display110 while the mobile device 1000 is bent as shown in FIG. 23B, and mayperform a corresponding operation.

In contrast, the elements such as the display 110, the controller 120,the storage 130, and the motion sensor 140 may be packaged into a singlemodule. In this case, the body 100 may be made of a flexible band.

FIG. 25 is a view illustrating a configuration of amountable/dismountable mobile device according to an embodiment of thepresent disclosure.

For example, FIG. 25 is a view illustrating a configuration of a mobiledevice according to an embodiment of the present disclosure.

Referring to FIG. 25, the mobile device 1000 includes a module 200 whichis mountable in or dismountable from the body 100. The display 110, thecontroller 120, the storage 130, and the motion sensor 140 are mountedin the module 200. The module 200 may be formed of a hard case.

The body 100 may be made of flexible material such as rubber, fabric orleather. One area of the body 100 is opened to allow the module 200 tobe mounted therein or dismounted therefrom. As illustrated in FIG. 25,the open area may be formed in a vertical direction or a horizontaldirection.

FIG. 26 is a view illustrating a configuration of a mobile device of abangle type a part of which is opened according to an embodiment of thepresent disclosure.

Referring to FIG. 26, the mobile device may have one side area of thebody 100 opened, and may allow a user's body such as a wrist or ankle tobe inserted through the open area.

FIG. 27 is a view illustrating a configuration of a mobile device a partof which is opened and closed according to an embodiment of the presentdisclosure.

Referring to FIG. 27, the mobile device may be implemented in ahandcuffs shape such that a part of the mobile device is opened andclosed. When the mobile device is implemented in the handcuffs shape, adoor 2711 to be opened and closed and a hinge 2710 to support the door2711 are provided on one side of the body 100. The user wears the mobiledevice by lifting up the door 2711 and opening the door 2711, insertingthe user's body (or portion thereof) through the open area, and thenlocking the door 2711. In this case, the display 110 may be formedopposite to the door.

Although not shown, according to various embodiments of the presentdisclosure, the mobile device 1000 may be implemented in a watch type.

FIG. 28 is a view illustrating a configuration of a mobile device whichis manufactured in such a form that the mobile device can be in closecontact with a user body according to an embodiment of the presentdisclosure.

For example, FIG. 28 is a view illustrating an example of an exterior ofthe mobile device 1000 according to an embodiment of the presentdisclosure.

Referring to FIG. 28, the mobile device 1000 may further include acushion 2830 and an air driver.

The cushion 2830 is provided on an inner surface of the body 100. Thecushion 2830 may be made of polymer resin such as rubber or vinyl, andmay be expanded and contracted by air.

The air driver supplies air to the cushion 2830 or deflates the cushion2830.

As illustrated in FIG. 28, the mobile device 1000 may be implemented inan annular bangle type. Because the mobile device1000 does not includeopenable door in the annular bangle, a diameter of the bangle should belarger than thickness of a user's body so that the user can wear thebangle around the user's wrist. Therefore, there is a risk that themobile device 1000 falls out of (e.g., off) the user's wrist as the userwears the mobile device 1000. In addition, even after the user wears themobile device 1000, the mobile device 1000 may be loosely supported andthus may be arbitrarily rotated or moved. Accordingly, controlling themobile device 1000 by rotating or moving the mobile device 1000 asdescribed above may be difficult. Accordingly, in FIG. 28, the mobiledevice 1000 may be brought into close contact with the user's body dueto the presence of the cushion 2830.

According to various embodiments of the present disclosure, the mobiledevice 1000 may further include a wearing button 2810 and a releasebutton 2820. The user may wear the mobile device and then may input awearing command by selecting the wearing button 2810. When the wearingcommand is input, the controller 120 drives the air driver to inject airinto the cushion 2830 and expand the cushion 2830. In contrast, when therelease button 2820 is selected, the controller 120 drives the airdriver to discharge air. Accordingly, the cushion 2830 may be contractedinto the original state. The air driver may be implemented by using anair pump or a pan.

Various buttons may be provided on the side surface of the body 100 ofthe mobile device 1000.

FIG. 29 is a view illustrating a configuration of a mobile device inwhich a button is provided on a side surface according to an embodimentof the present disclosure.

For example, FIG. 29 is a view illustrating an example of an exterior ofthe mobile device 1000 which includes a button according to anembodiment of the present disclosure.

Referring to FIG. 29, a plurality of buttons 171, 172, 173, and 174 ofvarious shapes may be provided on the opposite side surfaces of the body100 of the mobile device 1000. The buttons may include a wheel buttonand may include other various types of buttons such as a touch button ora push button.

Various functions may match (e.g., be associated) the plurality ofbuttons 171, 172, 173, and 174. For example, various functions such asturning on/off, changing a mode, a shortcut function, selecting,controlling a volume, and activating/inactivating may match the buttons.

As described above, the mobile device may be manufactured in variousshapes and may be worn on the user's body. Hereinafter, a control methodof a mobile device will be explained.

FIG. 30 is a flowchart to illustrate a control method of a mobile deviceaccording to an embodiment of the present disclosure.

Referring to FIG. 30, at operation 53010, the mobile device may detect amotion. The motion may include rotation of an upper plate of the mobiledevice or a movement of the mobile device. The configuration of themobile device may be implemented in various ways according to thevarious exemplary embodiments of the present disclosure as describedabove. The motion of the mobile device may vary according to a shape ofthe mobile device. The configuration of the mobile device, the types ofmotions, and the detecting method thereof have been described above indetail and thus a redundant explanation is omitted.

When the motion is detected at operation 53010, the mobile device mayproceed to operation 53020 at which the mobile device changes acurrently displayed screen. For example, the mobile device may executeanother application instead of a currently executed application, and maydisplay an execution screen of another application. In addition, themobile device may play back another content instead of a currentlyplayed back content, or may change the current screen to a zoom-in orzoom-out screen. In addition, the mobile device may activate orinactivate the screen, or may change the screen to a desktop screen, alock screen, or a unlock screen.

To detect the motion, the mobile device may employ a rotatableconfiguration as shown in FIGS. 2A, 2B, and 3, or may use a gyro sensor,a geomagnetic sensor, an acceleration sensor, and/or the like, asdescribed in FIG. 10 or may use any combination thereof. According tovarious embodiments of the present disclosure, an additional elementsuch as a camera or an EMG sensor may be used.

FIG. 31 is a flowchart to illustrate a method for performing a unlockoperation according to a motion of a mobile device and a user's eyesaccording to an embodiment of the present disclosure.

For example, FIG. 31 is a flowchart to explain a process of detecting amotion and performing a unlock operation in detail according to anembodiment of the present disclosure.

Referring to FIG. 31, at operation S3110, the mobile device determineswhether a motion of the mobile device is detected.

When a motion is detected at operation S3110, the mobile device proceedsto operation S3120 at which the mobile device determines whether themobile device is placed in an equilibrium state after being moved. Forexample, when the mobile device is of a bangle type, it is common thatthe user brings the mobile device in front of the user and uses themobile device. In this case, the mobile device is placed in theequilibrium state in parallel with the surface of the earth.

When the mobile device determines that the mobile device is placed inthe equilibrium state at operation S3120, the mobile device proceeds tooperation 53130 at which the mobile device may activate thephotographer.

At operation S3140, the mobile device photographs an image using theactivated photographer.

When the image is photographed at operation S3140, the mobile deviceproceeds to operation S3150 at which the mobile device analyzes thephotographed image and detects user's eyes.

When the mobile device detects the user's eyes at operation S3150, themobile device proceeds to operation S3160 at which the mobile deviceperforms a unlock operation.

In contrast, if the mobile device does not detect the user's eyes atoperation S3150, then the mobile device may return to operation S3140.

When a particular motion is not detected at operation S3110, the mobiledevice proceeds to operation S3170 at which the mobile device determineswhether a predetermined time elapses.

When a predetermined time elapses at operation S3170, the mobile deviceproceeds to operation S3180 at which the mobile device may enter a lockstate.

If the mobile device determines that a predetermined time has notelapsed at operation S3170, then the mobile device may return tooperation S3110.

As described above, the mobile device determines a user's position bycombining a photographed image and other data as well as the motion ofthe mobile device, and performs an operation corresponding to the user'sposition.

FIG. 32 is a block diagram to illustrate an overall configuration of amobile device according to embodiments of the present disclosure.

Referring to FIG. 32, the mobile device 1000 includes a display 110, acontroller 120, a storage 130, a motion sensor 140, a photographer 150,a communicator 160, a Global Positioning System (GPS) receiver 171, aDigital Multimedia Broadcasting (DMB) receiver 172, a buffer 173, atouch sensor 174, an audio processor 175, a video processor 176, aspeaker 177, a button 178, and a microphone 179.

The controller 120 may control an overall operation of the mobile deviceusing programs stored in the storage 130. Specifically, the controller120 may determine a user's position based on a motion of the mobiledevice, and may perform various control operations according to a resultof the determining. The configurations and operations of the display110, the controller 120, the storage 130, and the motion sensor 140 havebeen described above and thus a redundant explanation is omitted.

The photographer 150 photographs an image to determine presence/absenceof the user who wears the mobile device 1000 and the user's location asdescribed above. The photographed image may be analyzed by thecontroller 120. When it is determined that the user does not exist, thecontroller 120 may maintain the mobile device in the lock state withoutperforming a particular control operation or changing a screen.

The communicator 160 is configured to communicate with various types ofexternal apparatuses according to various communication methods. Thecommunicator 160 may include a Wi-Fi chip 161, a Bluetooth chip 162, aNear Field Communication (NFC) chip 163, and a wireless communicationchip 164. The Wi-Fi chip 161, the Bluetooth chip 162, and the NFC chip163 communicate with external apparatuses in a Wi-Fi method, a Bluetoothmethod, and an NFC method, respectively. The wireless communication chip164 communicates with external apparatuses according variouscommunication standards such as IEEE, Zigbee, 3^(rd) Generation (3G),3^(rd) Generation Partnership Project (3GPP), Long Term Evolution (LTE),and/or the like. The communicator 160 includes at least one of theabove-described various chips, or a chip according other communicationstandards, and may communicate with an external server or otherapparatuses using the chip. The controller 120 may access a web serverthrough the communicator 160, and may display a web screen.

The GPS receiver 171 receives a GPS signal from a GPS satellite andcalculates a current location of the mobile device 100. When anavigation program is executed, the controller 120 may perform anavigation operation with reference to a location detected by the GPSreceiver 171.

The DMB receiver 172 receives a DMB signal and processes the same.

The buffer 173 is configured to store screen data to be displayed on thedisplay 110.

The touch sensor 174 is configured to detect a touch on the surface ofthe display 110. The controller 120 compares coordinate values of eachobject in the displayed screen and touch coordinate values of the touchsensor 174, and determines which object is selected. The controller 120may perform various control operations according to the touchmanipulation detected by the touch sensor 174, in addition to oralternative to operations according to the motion detected by the motionsensor 140.

The audio processor 175 refers to an element that processes audio dataincluded in a content. The audio processor 175 performs variousprocessing operations such as decoding, amplifying, and noise filteringwith respect to audio data.

The video processor 176 refers to an element that processes video dataincluded in a content. The video processor 176 may perform various imageprocessing operations such as decoding, scaling, noise filtering, framerate conversion, and resolution conversion with respect to video data.

The audio processor 175 and the video processor 176 may be driven when aprogram to play back a content received from an external source or acontent stored in the storage 130 is executed. As described above, whenthe user moves the mobile device while a single audio content, movingimage content, or photo content is being played back, the controller 120may control the audio processor 175 or the video processor 176 to playback another content according to a degree of the motion and a directionof the motion.

The display 110 may display an image frame which is generated by thevideo processor 176. In addition, the speaker 177 may output audio datawhich is generated by the audio processor 175.

The microphone 179 receives a user's voice or other sounds and convertsthe user's voice or other sounds into audio data. The controller 130 mayuse a user's voice input through the microphone 179 for a call processor may convert the user's voice into audio data and store the audio datain the storage 130. For example, when a call is made, the controller 120may activate the microphone 179 and the speaker 177.

The button 178 may be arranged on the side surface of the body 100 asdescribed in FIG. 29.

The controller 120 may boot the mobile device 1000 using variousprograms and data stored in the storage 130, and may perform an imagedisplay method according to the above-described exemplary embodiments.

The controller 120 includes a Random Access Memory (RAM) 121, a ReadOnly Memory (ROM) 122, a main CPU 123, a Graphic Processing Unit (GPU)124, and a bus 125.

The RAM 121, the ROM 122, the main CPU 123, and the GPU 124 may beconnected to one another through the bus 125. Besides these, thecontroller 120 may further include various interfaces, but illustrationand description thereof are omitted.

The main CPU 123 accesses the storage 130 and performs booting using theO/S stored in the storage 130. The ROM 122 stores a set of commands toboot the system. When a turn on command is input and power is supplied,the main CPU 123 copies the O/S stored in the storage 130 to the RAM 121according to a command stored in the ROM 122, executes the O/S and bootsthe system. When the booting is completed, the main CPU 123 copies thevarious programs stored in the storage 130 into the RAM 121, executesthe programs copied into the RAM 121, and performs various operations.

The GPU 124 may generate a desktop screen, an icon display screen, aunlock screen, and other transition screens under the control of themain CPU 123. The GPU 124 calculates attribute values of objects in thescreen such as coordinate values, shape, size, and color based on thescreen data stored in the storage 130. The GPU 124 may generate theabove-described various screens based on the calculated attributevalues. The generated screen data is stored in the buffer 173. Thescreen data stored in the buffer 173 may be displayed by the display110.

When the communicator 160 is included as illustrated in FIG. 32, themobile device 1000 may be interlocked with another mobile device orshare data with another mobile device. For example, when a gesture ofslapping high fives to another user who wears a mobile device of abangle type is detected, the mobile device may exchange commands or datawith the mobile device of another user using NFC or other wirelesscommunication methods.

FIG. 32 illustrates various elements which are mountable in the mobiledevice when the mobile device is implemented as a terminal apparatussupporting various functions, such as a communicating function, a DMBfunction, and a GPS receiving function according to an embodiment of thepresent disclosure. Accordingly, some of the elements shown in FIG. 32may be omitted or changed, and another element may be added according toan exemplary embodiment.

According to various embodiments of the present disclosure, the mobiledevice may be manufactured in various shapes, and thus the mobile devicemay be employed in an external apparatus for use. For example, when themobile device is employed in a vehicle such as a bicycle, an auto bike,or a car instead of the user's body, the mobile device may be used bydetecting a moving direction or speed of the vehicle. For example, themobile device may display locations of members of a group or may informthe user of whether there is a member distanced away from the group. Inaddition, when the mobile device is used in a shopping cart of a majorsupermarket, the mobile device may communicate with a server provided inthe major supermarket, and may support various services. For example,when information on a product that the user wishes to buy is input, themobile device may display a location or direction of the product to bebought. In addition, the mobile device may provide a variety of eventinformation provided by the server through a screen or a sound. Inaddition, the mobile device may display a list of products that the userwishes to buy, or may allow the user to make a payment for the boughtproduct directly using a card recognition function.

According to the various embodiments of the present disclosure asdescribed above, the user may wear the mobile device on various objectsas well as the user's wrist or other bodies, and may easily carry anduse the mobile device. The user may interact with the mobile device bymaking various gestures, such as moving user's arm vertically orhorizontally, unfolding user's arm and lowering user's wrist, raisinguser's wrist as if the user looks a watch, moving user's hand up,rotating user's wrist in a clockwise direction or a counter clockwisedirection like the user flicks the user's wrist, and/or the like.Accordingly, the user's convenience can be greatly improved.

According to the above-described embodiments of the present disclosure,the user wearing the mobile device of the bangle type controls theoperations of the mobile device by moving the user's body. However, theoperations of the mobile device may be controlled according to a touchmanipulation other than the motion. In this case, according to variousembodiments of the present disclosure, the mobile device may provideUser Interfaces (UIs) of various configurations to allow the user to usea pre-installed application easily.

FIG. 33 is a block diagram illustrating a configuration of a mobiledevice according to an embodiment of the present disclosure.

Referring to FIG. 33, a mobile device 3300 includes a display 3310, astorage 3320, and a controller 3330.

The storage 3320 stores an application that is installed in the mobiledevice 3300. The application may be downloaded from an application storeor may be installed as default.

The controller 3330 generates a list UI using information on theapplication stored in the storage 3320. The list UI includes applicationitems corresponding to the applications stored in the storage 3320. Forexample, an application item may display an icon indicating a name and acharacteristic of each of the applications associated therewith.

The display 3310 displays the list UI which is generated by thecontroller 3330.

When a predetermined event occurs, the controller 3330 executes anapplication corresponding to at least one application item in the listUI, and generates an execution screen of the application. The controller3330 displays the execution screen on a display location of thecorresponding application item in the list UI.

According to various embodiments of the present disclosure, the eventrecited herein may include an event in which the mobile device 3300 isturned on, an event in which the mobile device 3300 is unlocked, anevent in which an application item is selected in the list UI, an eventin which user's eyes on the list UI is detected, an event in which apredetermined time period arrives, and/or the like.

FIGS. 34A, 34B, and 34C are views illustrating an example of aconfiguration of a list UI of a mobile device according to an embodimentof the present disclosure.

Referring to FIG. 34A, a list UI 3400 includes a plurality ofapplication items 3410 to 3460. One application item 3430 out of theapplication items 3410 to 3460 may be displayed in the form of anexecution screen and the other application items are displayed withapplication names only. When a message application is executed, amessage 3431 which is transmitted or received may be displayed in anexecution screen 3430 of the message application. Accordingly, the usercan easily determine the applications stored on the mobile device 3300(e.g., check kinds of installed applications) and may view executionscreens of some of the applications on the mobile device 3300.

The controller 3330 may control the display 3310 to change a displaystate of the list UI according to a user manipulation.

Specifically, when a first user manipulation is performed in a directionparallel to an arrangement direction of the application items in thelist UI 3400, the controller 3330 rotates the list UI according to thedirection of the first user manipulation and changes the executionscreen to an execution screen of another application.

In addition, when a second user manipulation is performed on theexecution screen of the application, the controller 3330 changes acontent displayed on the execution screen of the application accordingto the direction of the second user manipulation. For example, when asecond user manipulation is performed on the execution screen of theapplication in a direction perpendicular to the arrangement direction ofthe items, the controller 3330 changes a content displayed on theexecution screen of the application according to the direction of thesecond user manipulation.

According to various embodiments of the present disclosure, as shown inFIG. 34A, when the application items are arranged in a verticaldirection, the first user manipulation corresponds to a manipulation ofdragging, flicking, or the like in the vertical direction, and thesecond user manipulation corresponds to a manipulation of dragging,flicking, or the like in a horizontal direction.

When the user performs the first user manipulation in an upward ordownward direction after touching the application execution screen 3430or the list UI 3400 in FIG. 34A, the list UI moves in a directioncorresponding to the direction of the first user manipulation and a newexecution screen 3440 is opened as shown in FIG. 34B. In FIG. 34B, thefirst user manipulation is performed in the upward direction and a musicapplication placed under the message application is executed.Accordingly, the execution screen 3440 of the music application isdisplayed on a corresponding item location in the list UI. In theexecution screen 3440 of the music application, a display area 3441displaying information such as an image or an album photo identifying amusic content, a music content name, and the like, and a menu area 3442displaying a menu for controlling playback of the music content may bedisplayed. The user may input various control commands to play back,stop, pause, fast rewind, and fast forward the music content using themenu area 3442.

In addition, the user may perform the second user manipulation ofdragging or flicking on the application execution screen in thehorizontal direction. For example, when the second user manipulation isperformed on the execution screen 3430 of the message application in theleftward or rightward direction, a previous content 3431 is changed toanother content 3432 as shown in FIG. 34C.

As described above, the user of the mobile device may freely change theapplication or contents only with a simple manipulation.

Although only one application item is displayed in the form of anexecution screen in FIGS. 34A, 34B, and 34C, execution screens of theplurality of applications may be displayed. In this case, a size of eachexecution screen may be adjusted according to a user manipulation.

FIGS. 35A, 35B, and 35C are views illustrating a screen of a mobiledevice which provides a plurality of execution screens according to anembodiment of the present disclosure.

Referring to FIG. 35A, a plurality of execution screens 3520, 3530, and3540 are displayed in a list UI 3500 along with application items 3510,3550, 3560, and 3570. Each of the execution screens 3520, 3530, and 3540displays a result of executing the corresponding application. Forexample, the execution screen 3520 of the contact list application maydisplay contact information and phone numbers stored in the mobiledevice, and the execution screen 3530 of the message application maydisplay messages which are transmitted or received. The execution screen3540 of the album application may display images and moving imagecontents stored.

In this state, the user may increase or reduce a size of the executionscreen by performing an appropriate manipulation on the executionscreen. For example, the size of the execution screen may be adjusted byperforming a manipulation like pinch out or pinch in. The pinch inrefers to an operation of touching the screen with two or more fingersand then moving the user's fingers closer together, and the pinch outrefers to an operation of touching the screen with two or more fingersand then moving the user's fingers further apart.

The controller 3330 calculates a coordinate value of a touch point usinga touch sensor operatively integrated with the display 3310. Forexample, the touch sensor may be embedded in the display 3310. When aplurality of touch points are calculated, the controller 3330 calculatesa distance between a coordinate value of a first touch point and acoordinate value of a next touch point. In addition, the controller 3330monitors whether the calculated distance is changed or not. As a resultof the monitoring, when the calculated distance decreases, thecontroller 3330 determines that a pinch in occurs, and, when thecalculated distance increases, the controller 3330 determines that apinch out occurs.

When the controller 3330 determines that the pinch in occurs, thecontroller 3330 reduces the size of the execution screen at which eachtouch coordinate values is placed by as much as the degree of the pinchin. When the controller 3330 determines that the pinch out occurs, thecontroller 3330 increases the size of the execution screen at which eachtouch coordinate value is placed by as much as the degree of pinch out.

FIG. 35B illustrates a state in which the pinch out is performed on theexecution screen 3530 of the message application and the executionscreen 3530 elongates in the vertical direction. Because the size of thewhole execution screens 3520, 3530, and 3540 is fixed in FIG. 35B, asthe execution screen 3530 of the message application is enlarged, thesizes of the other execution screens 3520 and 3540 are reduced.Alternatively, the sizes of the other execution screens 3520 and 3540may be maintained and eventually the size of the whole execution screens3520, 3530, and 3540 may increase.

The user may enlarge the execution screen 3530 to a full screen byperforming a predetermined manipulation such as simple touch, longtouch, double touch, and/or the like on the execution screen 3530. Forexample, when the execution screen 3530 of the message application istouched in FIG. 35B, the controller 3330 may enlarge the executionscreen to the full screen of the display as shown in FIG. 35C. When theexecution screen is enlarged to the full screen, the user may check(e.g., view) messages exchanged with another user by scrolling up ordown the execution screen or manipulating the execution screen to theleft or right.

In the above-described embodiment of the present disclosure, theexecution screen is always displayed on the list UI. However, theexecution screen may be in an on or off state in the list UI accordingto user selection.

FIGS. 36A and 36B are views illustrating a screen configuration of amobile device according to an embodiment of the present disclosure.

Referring to FIGS. 36A and 36B, the display 3310 of the mobile device3300 displays a list UI 3600 including application items. The user mayselect an application item that the user wants to view. When a messageapplication item is touched (e.g., as denoted by reference letter T) asshown in FIG. 36A, the touched item is moved to a specific location ofthe list UI and an execution screen 3610 is opened. According to variousembodiments of the present disclosure, the specific location at whichthe list UI and the execution screen 3610 is opened may be a visiblearea that is frequently viewed by the user in the list UI. According tovarious embodiments of the present disclosure, the execution screen 3610may be opened at a position substantially corresponding to the positionat which the application item that is touched was previously displayed(e.g., before the touch event).

A transmitted or received message 3620 and various menu icons 3631,3632, and 3633 are displayed in the execution screen 3610. In FIG. 36B,menu icons 3631, 3632, and 3633 to perform various functions such ascalling, replying, deleting, and the like, are displayed. Accordingly,an important function may be directly performed on the list UI withoutsignificant interaction. For example, a user may perform an important(e.g., or predefined) function based on a direct interaction (e.g., atouch) with the list UI (e.g., a menu icon).

As described above, the mobile device is formed in the bangle type. Thedisplay 3310 may be disposed along the entire outer surface of the bodyof the bangle type. Accordingly, the list UI may be displayed on theentire outer surface of the mobile device.

FIGS. 37A and 37B are views illustrating a list UI which is displayed ona mobile device of a bangle type according to an embodiment of thepresent disclosure.

Referring to FIG. 37A, a list UI 3700 is displayed on an entire outersurface of the mobile device. The list UI 3700 may be a cyclic UI thatis circulated according to a user manipulation. For example, the userrotates the list UI 3700 by touching the list UI and then dragging orflicking in a direction parallel to an item arrangement direction asshown in FIG. 37A.

A distinct area 3720 may be displayed between a first item and a lastitem of the application items as shown in FIG. 37B. In addition, adisplay area 3710 informing that the UI is the list UI may be furtherdisplayed on an upper end of the first item. The distinct area 3720 maybe an empty space that does not display any extra information or may bedisplayed in a different color or image.

According to various embodiments of the present disclosure, when manyapplications are installed, all of the application items may not bedisplayed on a single screen. In addition, searching for an applicationitem that the user wants throughout the list UI may not be easy.Accordingly, according to various embodiments of the present disclosure,an indicator for directly searching for each application item may befurther displayed.

FIGS. 38A, 38B, and 38C are views illustrating a screen on which a listUI is displayed along with indicators according to an embodiment of thepresent disclosure.

Referring to FIGS. 38A, 38B, and 38C, indicators 3810 regardingapplications stored in the storage 3320 are displayed on one side of alist UI 3800. The indicators 3810 refer to identifiers corresponding toa plurality of groups into which a plurality of application items areclassified according to a certain classifying criterion. For example,the application items may be classified with reference to an initialsound or a first letter of the name of the application item, or may beclassified with reference to a kind of application such as a game, adocument, and utility. In addition, a predetermined number ofapplication items may be classified according to an installation order.In FIG. 38A, the indicators 3810 like A to F are displayed.

When the user drags in a direction as the user wants as shown in FIGS.38A and 38B, a display state of the list UI is changed. In this case,the indicators 3810 may be fixed at the same position.

When one of the indicators is selected, the controller 3330 may rotatethe list UI to display an application item corresponding to the selectedindicator on a visible area. For example, when the user selects theindicator E as shown in FIG. 38C, application items belonging to theindicator E are displayed on the list UI 3800. Although the list UI 3800consisting of only the application items is illustrated in FIGS. 38A,38B, and 38C, some of the application items may be displayed in the formof an execution screen as described above. In this case, an applicationitem that is displayed on a specific location of the changed list UI3800 from among the applications belonging to the selected indicator maybe automatically displayed in the form of the execution screen.

According to various embodiments of the present disclosure, a locationof each application item in the list UI may be arbitrarily adjusted bythe user. For example, the user may configure at least one order inwhich the application items in the list UI may be adjusted. The list UImay arrange the applications according to favorites, most frequentlyused, most recently downloaded and/or installed, and the like.

FIGS. 39A and 39B are views illustrating a method for changing a displaylocation of an application item according to an embodiment of thepresent disclosure.

Referring to FIGS. 39A and 39B, a list UI includes a plurality ofapplication items 3910 to 3960 as shown in FIG. 39A, a plurality ofapplication items 3920 to 3970 as shown in FIG. 39B. An application item3930 of a specific location from among the application items may bedisplayed in the form of an execution screen. As shown in FIGS. 39A and39B, the execution screen may be a main screen that indicates a batterylevel, a communication state, date, time, and/or the like of the mobiledevice.

In this state, when the user touches one application item 3940 for along time (e.g., for a time period that is greater than a predefinedthreshold) and drags the touch to a location of another application item3920, a display location of the selected application item 3940 ischanged as shown in FIG. 39B. According to various embodiments of thepresent disclosure, an application item to be moved may be selected byusing various manipulations other than the long touch, such as, forexample, a double touch, menu selection, and/or the like.

According to various embodiments of the present disclosure, theapplication items included in the plurality of application items may beidentical before the touch for moving a location of a selectedapplication item as the application items included in the plurality ofapplication items after the touch for moving the location of selectedapplication items is input. For example, the touch for moving thelocation of the selected application items may not change the set ofapplication items being displayed.

In the various embodiments of the present disclosure described above,the list UI has application items arranged in sequence. However, theshapes of the list UI and the application items may be changedvariously.

For example, a list UI in the form of a water drop may be provided.Specifically, an application execution screen may be displayed whensmall bubbles in water come up above water, are absorbed into anexisting air bubble, and the air bubble becomes gradually bigger. Inaddition, an application execution screen may be displayed when an airbubble in the form of a sphere is pressed and becomes gradually thinner.In addition, an application execution screen may be displayed when airis injected into an air bubble and the air bubble is expanded andbursts.

FIGS. 40A, 40B, 40C, 40D, and 40E are views illustrating a configurationof a mobile device according to an embodiment of the present disclosure.

Referring to FIG. 40A, the mobile device displays a list UI 4000. Inthis state, when one application item is selected or is placed on avisible area, the area at which the application item is displayed isenlarged as shown in FIG. 40B. In FIG. 40B, the third application itemis enlarged and an object 4010 in the form of a small water drop isdisplayed on the area of the application item. When the water dropobject 4010 is gradually expanded and bursts as shown in FIGS. 40C and40D, the object 4010 is substituted with an execution screen 4020 of thecorresponding application item as shown in FIG. 40E.

FIGS. 41A and 41B are views illustrating a list UI which is generated ina form of a water drop according to an embodiment of the presentdisclosure.

Referring to FIG. 41A, the mobile device displays a standby screen 4100.The standby screen 4100 may be displayed in a lock state or a standbystate. An object in the form of a water drop including a minute hand4101 and an hour hand 4102 of a clock may be displayed in the standbyscreen 4100. A location of the object may be shaken according to amotion of the mobile device.

In a state in which the standby screen shown in FIG. 41A is displayed,when the user inputs a gesture to unlock or selects a button, thestandby screen is changed to a list UI screen 4110 as shown in FIG. 41B.

As shown in FIG. 41B, a plurality of application items 4111 to 4115 maybe displayed in the list UI screen 4110. The application items 4111 to4115 are displayed in the form of a water drop object as shown in FIG.41B. According to various embodiments of the present disclosure,information on a corresponding application or an execution screen may bedisplayed in the object as a thumbnail image (e.g., within theassociated application item 4111 to 4115).

A highlight effect may be provided to an application item placed on aspecific area in the list UI screen 4110. In FIG. 41B, the firstapplication item 4111 placed at the center area is displayed as a largeand bright image. The application items 4111 to 4115 may be displayed asfixed images. However, an object display location or a surface shape maybe displayed as if it is shaken according to a motion of the userwearing the mobile device.

FIGS. 42A, 42B, 42C, and 42D are views to illustrate a method forchanging a list UI such as, for example, the method for changing thelist UI shown in FIGS. 41A and 41B according to an embodiment of thepresent disclosure.

As shown in FIG. 42A, the list UI 4110 in which the application items4111 to 4115 are displayed in the form of a water drop may be displayed.The application items 4111 to 4115 are randomly arranged in the screen.According to various embodiments of the present disclosure, a user mayconfigure an arrangement of the application items 4111 to 4115.According to various embodiments of the present disclosure, theapplication item corresponding to the largest displayed application itemmay be configured by a user as a favorite application item, a mostrecently used application item, a most frequently used application item,and/or the like. According to various embodiments of the presentdisclosure an application item that is displayed as the largestapplication item by default may be configured by the user.

The user may change the application item placed at the center byscrolling up and down. Specifically, when the user touches the screen(e.g., as denoted by reference letter T illustrated in FIG. 42A) anddrags, or flicks the touch, and/or the like, the list UI 4110 is changedaccording to a direction of the manipulation and display locations ofthe application items 4111 to 4115 are also changed. Accordingly, whenan application item 4116 placed under a bottom side is placed at thecenter area as shown in FIG. 42B, the application item 4116 is enlargedand displayed brightly and an execution screen of the correspondingapplication is displayed in the application item 4116.

FIG. 42B illustrates a case in which the corresponding application is aphoto album application. In this case, as shown in FIG. 42C, one 4116 aof the stored photos may be displayed in the water drop. In this state,when the user drags or flicks in the horizontal direction, another photo4116 b is displayed in the water drop as shown in FIG. 42D. In addition,various menus selectable by the user as well as content may be displayedin the water drop object according to a kind of application. When onewater drop object is directly selected, the selected water drop objectmay be enlarged and displayed as if the water drop is viewed from aclose range and may additionally display information and a function.

FIGS. 43A, 43B, 43C, and 43D are views illustrating a water drop objectwhich is enlarged and displayed according to an embodiment of thepresent disclosure.

When one 4310 of the water drop objects is selected as shown in FIG.43A, the selected water drop object is enlarged and displayed on thefull screen as shown in FIG. 43B. In FIGS. 43A, 43B, 43C, and 43D, amusic application is selected. In this case, a representative image 4311on one of the music contents and control menus 4312 thereof aredisplayed. The user may play back the music content by manipulating thecontrol menus 4312.

In this state, when the user flicks in the horizontal direction, thecontent is changed to another content. Accordingly, a representativeimage 4313 on the new content and control menus 4312 are displayed. Acolor of the water drop object or background may be changed according toa kind of content.

When the user wants to return to the original state, the user may selecta button matching a back function or may input a gesture matching theback function. For example, FIG. 43C illustrates a pinch in manipulationin which the user touches two points T1 and T2 with fingers and move thefingers closer together. Accordingly, as shown in FIG. 43D, thecontroller 3330 may change the list UI to the original state and displaythe list UI. In this case, the representative image 4313 of the changedcontent may be displayed in the application item 4310 displayed at thecenter area. Accordingly, the user may directly check (e.g., determine)the content that has been most recently played back on the list UI.

In addition, the list UI may be displayed in various shapes.

FIGS. 44A, 44B, 44C, and 44D illustrate an example of the list UI shapeaccording to an embodiment of the present disclosure.

Referring to FIG. 44A, a list UI 4400 is displayed in the form of afamiliar tool that is easy to have in a real life such as a drawer, abookshelf, a box, and the like, and an application item is displayed inthe form of paper, photo, and file that is piled in the tool insequence.

FIG. 44A illustrates application items which are displayed in the formof files. An application name may be recorded on each file. In thisstate, when the user selects one file 4410, a graphic effect is providedas if the selected file is opened and an execution screen of thecorresponding application is displayed. In FIG. 44B, a memo applicationis selected and an execution screen 4410 displaying a content of a memois displayed. When the memo content is long, a menu 4411 for scrollingthe memo content may also be displayed. In addition, when many memos arestored, an image 4412 shown as if a plurality of documents are piled maybe additionally displayed on a lower portion of the execution screen4410.

In this state, when the user touches a corner of the memo and drags orflicks the touch as if the user turns over the page, the previous memodisappears as if the memo is torn off and another memo is displayed inthe execution screen 4410 as shown in FIG. 44C. For example, theexecution screen may be expressed like an adhesive memo pad.

In addition, the user may check additional information by touching theexecution screen 4410 or touching the image 4412. In FIG. 44D, when theuser touches the execution screen 4410, detailed information 4413 suchas a creation date or a writer of the memo may be displayed at the touchpoint. Also, when the user touches the image 4412, a message 4414indicating a number of stored memos may be displayed.

According to various embodiments of the present disclosure, the mobiledevice may be implemented in a bangle type as described above. In thiscase, when the user sees the mobile device with the user's naked eyes,only half of the outer surface comes into view. Therefore, even when thedisplay 3310 is disposed enclosing the entire outer surface of themobile device or occupies more than half of the area, an area that isvisible to the user is limited. The area that is actually visible to theuser is referred to as a visible area in the specification. When themobile device is rotated, the visible area is changed. When the visiblearea is changed, the controller 3330 may change the list UI accordingly.

FIGS. 45A, 45B, and 45C are views to illustrate a process of changing alist UI according to a change of a visible area according to anembodiment of the present disclosure.

FIG. 45A illustrates a case in which the user sees a middle area whenthe mobile device of the bangle type is unfolded. In this case, avisible area is placed on the middle area from among all areas of thedisplay 3310. Accordingly, a 11^(th) application item placed in themiddle area is highlighted and indicators 4510 are displayed around the11^(th) application item. An execution screen of the application may bedisplayed on the highlighted application item as in the above-describedembodiment of the present disclosure.

In this state, when the user sees an upper area of the display 3310, thevisible area is moved to the upper area. Accordingly, the list UI slidesin an upward direction and 9^(th) to 15^(th) application items displayedin the previous visible area are displayed on the upper area as shown inFIG. 45B. In addition, the indicators 4510 are moved to the upper area.

In contrast, when the user sees a lower area, the list UI slides in adownward direction and the 9^(th) to 15^(th) application items displayedin the previous visible area are displayed on the lower area as shown inFIG. 45C. In addition, the indicators 4510 are moved to the lower area.

A non-visible area that cannot be seen by the user may be processeddifferently according to an embodiment of the present disclosure.

FIGS. 46A, 46B, and 46C are views illustrating a screen configurationaccording to a list UI display method according to an embodiment of thepresent disclosure.

Referring to FIG. 46A, application items and indicators 4510 aredisplayed in a visible area out of the whole area of the display 3310and the other areas, for example, non-visible areas that are not visibleto the user's eyes are turned off in part. As shown in FIGS. 46B and46C, when the user's eyes move in an upward direction or a downwarddirection, the location of the visible area is changed according to themoving direction. When the display 3310 includes an Organic LightEmitting Diode (OLED) or the like, and a pixel represents black, thepixel does not consume power and a power saving effect can be obtained.

Although the list UI is changed according to the location of the visiblearea in FIGS. 45A to 46C, the screen of the display 3310 may bemaintained if necessary even when the visible area is changed. Forexample, the user may rotate the mobile device of the bangle type to seean image of a part that the user wants to see. Accordingly, when apredetermined user gesture is detected, the controller 3330 may fix thescreen of the display 3310 according to a current configuration thereofeven when the visible area is changed. For example, when a user gestureof gripping the body of the mobile device with the user's palm androtating the mobile device is detected, or when the visible area ischanged after a specific menu displayed on the screen is selected, thescreen may be fixed.

According to various embodiments of the present disclosure, theabove-described indicators may be always fixed, but may not be displayedusually and may be displayed when the indicators are used.Alternatively, the indicators may usually be displayed in simple andsmall sizes, and, when a specific event occurs, the indicators may bechanged to detailed indicators.

FIGS. 47A, 47B, and 47C illustrate a user gesture to display indicatorsaccording to an embodiment of the present disclosure.

Referring to FIG. 47A, the mobile device 3300 displays a first indicator4710 in a list UI 4700. In this state, when the user long-taps the firstindicator 4710 or holds the first indicator 4710 with the user's hand, asecond indicator 4720 is displayed beside the user's finger as shown inFIG. 47B. The second indicator 4720 may be comprised of indexinformation that is greater and more specific than the first indicator4710. The user may move the list on an index basis by scrolling orrubbing while tapping or holding the second indicator 4720.

FIGS. 48A and 48B are views illustrating a configuration of a list UI towhich indicators are added according to an embodiment of the presentdisclosure. For example, FIGS. 48A and 48B are views enlarging thescreens of FIGS. 47A, 47B, and 47C according to an embodiment of thepresent disclosure.

Referring to FIG. 48A, index information 4811-1, 4811-2 of acorresponding group is additionally displayed for the first item of eachgroup from among the application items in the list UI 4700.

In this state, when the user makes a gesture of long tapping or holdingwith the user's hand, the first indicator 4710 is changed to the secondindicator 4720 as shown in FIG. 48B. In this state, when the user dragsup the user's hand, application items belonging to a group L, which arenext to application items belonging to a group K currently displayed onthe visible area, may be displayed directly.

As described above, various list Uls may be provided considering shapecharacteristics of the mobile device of the bangle type.

According to the various embodiments of the present disclosure explainedin relation FIGS. 33 to 48B, the user changes the list UI throughvarious touch manipulations. However, the operation of the list UI maybe controlled according to a motion of the mobile device or a locationof the user as described above. For example, the mobile device explainedin FIG. 33 may be implemented in combination with the variousembodiments of the present disclosure explained in relation to FIGS. 1to 32. Accordingly, the mobile device may determine the visible area invarious methods other than the user touch manipulation and mayautomatically change the list UI.

FIGS. 49A to 50C illustrate a method for determining a visible areaaccording to various embodiments of the present disclosure.

Referring to FIGS. 49A, 49B, and 49C, a method for determining a visiblearea using a gyro sensor, a geomagnetic sensor, an acceleration sensor,and the like, is illustrated. Because the method for detecting a motionof the mobile device using these sensors has been described in detail inthe above-described embodiments of the present disclosure, a redundantexplanation is omitted.

FIG. 49A illustrates a visible area in a normal state. Although themobile device is fixed in a bangle state by means of securing means 4910and 4920 in FIGS. 49A, 49B, and 49C, the mobile device may beimplemented as a flexible device or may be implemented in any othershape as described above.

The normal state recited herein refers to a state in which at least oneof a pitch angle, a roll angle, and a yaw angle that is detected whenthe user wears the mobile device on the user's wrist and adjusts theback of the user's hand to the user's eyes satisfies an angle range. Forexample, when the pitch angle and the roll angle measured in thehorizontal state are 0°, the normal state is determined when the pitchangle and the roll angle are measured in the range of −20˜+20°. Such anangle range may be measured in advance through an experiment and may bestored in the storage 3320 of the mobile device. According to variousembodiments of the present disclosure, the angle range may beconfigurable by the user (e.g., according to user preferences). In thenormal state, the middle area out of the whole area of the display 3310of the mobile device is determined as a visible area.

In this state, when the user rotates the user's wrist in an upwarddirection by 90°, the securing means 4910 and 4920 are orienteddownwardly and the visible area is changed to a lower area out of thewhole area of the display 3310 as shown in FIG. 49B. In contrast, whenthe user rotates the user's wrist in a downward direction by 90° in thestate shown in FIG. 49A, or rotates the user's wrist by 180° in thestate shown in FIG. 49B, the securing means 4910 and 4920 are orientedupwardly. Accordingly, the visible area is changed to an upper area outof the whole area of the display 3310 as shown in FIG. 49C.

Referring to FIGS. 50A, 50B, and 50C, a method for determining a visiblearea by photographing the user according to an embodiment of the presentdisclosure is illustrated. At least one sensor, camera, and/or the likemay be implemented and used to determine the visible area more exactly.In FIGS. 50A, 50B, and 50C, two sensors, cameras, and/or the like areincluded.

As shown in FIG. 50A, two sensors, cameras, and/or the like 151 and 152may be spaced apart from each other by more than a predetermineddistance in the display 3310 of the mobile device. To avoid a limit ofscreen display, each sensor, camera, and/or the like 151 and 152 may beplaced on a side of the mobile device.

The controller 3330 analyzes images photographed by the two sensor,camera, and/or the like 151 and 152 and identifies a subject.Specifically, the controller 3330 recognizes a facial area of the user.Because the method for recognizing a face has been already described inthe above-described embodiments of the present disclosure, a redundantexplanation is omitted. In a normal state in which the user looks aheadof the mobile device as shown in FIG. 50A, the user's face may bephotographed by the two sensors, cameras, and/or the like 151 and 152.When a facial area is recognized from the whole image photographed bythe two sensors, cameras, and/or the like 151 and 152, the controller3330 determines the normal state and determines a screen area of thedisplay 3310 placed between the two sensors, cameras, and/or the like151 and 152 as a visible area.

According to various embodiments of the present disclosure, when theuser's face is detected only by the first sensors, cameras, and/or thelike 151, as shown in FIG. 50B, a screen area of the display 3310disposed around the first photographer 151 is determined as a visiblearea, and, when the user's face is detected only by the second sensors,cameras, and/or the like 152, as shown in FIG. 50C, a screen area of thedisplay 3310 disposed around the second photographer 152 is determinedas a visible area.

When the user visible area is determined, the controller 3330 mayexecute an application corresponding to an item displayed on apredetermined location of the visible area and may display an executionscreen of the executed application on the corresponding location.

According to the various embodiments of the present disclosure describedabove, the mobile device provides the list UI regarding the installedapplications and provides execution screens of some of the applicationsalong with the list UI, so that the user can easily use theapplications.

FIG. 51 is a flowchart to illustrate a UI display method according tovarious embodiments of the present disclosure.

Referring to FIG. 51, at operation 55100 the mobile device displays alist UI.

At operation S5110, at least one application is executed.

At operation S5120, a resulting execution screen is displayed in thelist UI. According to an embodiment of the present disclosure, theexecution screen may be directly displayed on the initial list UI or maybe displayed only when being selected by the user.

In this state, the user may manipulate the list UI in variousdirections. At operation S5130, the mobile device determines whether theuser manipulated the list UI.

If the mobile device determines that the user manipulates the list UI atoperation S5130, then the mobile device may proceed to operation S5140at which the mobile device changes a display state of the list UIaccording to a user manipulation direction. For example, the mobiledevice may change application items displayed on the list UI or maychange a content displayed on the execution screen of the application.

In contrast, if the mobile device determines that the user did notmanipulate the list UI at operation S5130, then the mobile device maycontinue to poll for indication of user manipulation of the list UI. Asan example, the mobile device may perform other corresponding functionsor operations while polling for an indication of user manipulation.

In addition, the list UI and the execution screen may be provided invarious shapes as described in relation to FIGS. 33 to 50C.

Accordingly, the mobile device of the bangle type can be used moreeffectively and easily.

Because the mobile device of the bangle type is carried by the userwhile being directly worn on the user's body as described above, themobile device may be used when the user does exercise such as running orgymnastics. Accordingly, the mobile device may provide various servicessuch as measuring an amount of exercise, managing health, and managing abody shape. It may be difficult to control the mobile device in amanipulation method using touch, motion gesture, voice recognition,and/or the like because the mobile device is greatly shaken and isaffected by ambient noise when the user does exercise. Accordingly,manipulating the mobile device in a simpler method according to a useenvironment of the mobile device may be necessary. Hereinafter, variousscenarios in which the mobile device of the bangle type is used, andexamples of a UI configuration thereof will be explained in detail.

FIGS. 52, 53, 54, 55, 56A, 56B, and 56C are views to illustrate a UIdisplay method using a display of a seamless form according to anembodiment of the present disclosure. For example, FIGS. 52 to 55 areviews to illustrate an example of a screen display method of a mobiledevice which is implemented to have a display larger than a visible areaaccording to various embodiments of the present disclosure.

As explained in relation to FIGS. 2A to 4C, the display 110 may bedisposed on the entire outer surface of the mobile device 100 in aseamless form. According to various embodiments of the presentdisclosure, the display 110 may be implemented to be rotatable withreference to the body on the surface of the mobile device 100.

In this case, even when an execution screen of an application stored inthe storage 130 is displayed on an entire display area of the display110, a part of the execution screen is shown in a visible area which isactually visible to the user. For example, when the mobile device 100 isimplemented as a bangle type, only a display area that the user looks isshown and an execution screen displayed on a display area behind theforward display area is not shown.

When a user interaction is detected by a sensor such as the touch sensor174 and the motion sensor 140, the controller 120 may change the part ofthe execution screen displayed in the visible area according to the userinteraction. The user interaction may refer to various manipulationssuch as a rubbing operation which covers the surface of the display 110with the user's palm and drags up or down in one direction, simplytouching the surface of the display 110 and dragging or flicking, andmoving or twisting a body wearing the mobile device 100. When the userinteraction is detected, the controller 120 may change the part shown inthe visible area by scrolling the execution screen in a directionmatching the user interaction.

FIG. 52 illustrates the display which is placed in a horizontaldirection. In this case, only a part 5210 of the execution screen 5210and 5220 is shown in the visible area. In this state, when the userperforms a defined interaction, the other part 5220 is shown in thevisible area.

FIG. 53 illustrates the display which is placed in a vertical direction.In this case, a part of the execution screen 5310 and 5320 that is shownin the visible area is adjusted according to a user interaction.

In FIGS. 52 and 53, the screen is changed in 2 depth when the wholedisplay area is about 2 times larger than the visible area. However, thewhole display area may be more than 2 times larger than the visiblearea,

FIG. 54 illustrates an example in which the screen is changed in 3depth. Referring to FIG. 54, the execution screen may be divided into 3phases 5410, 5420, and 5430 and each screen unit may be displayed in thevisible area.

FIG. 55 illustrates an example of an execution screen which isimplemented in 3 depth. Specifically, FIG. 55 illustrates an executionscreen which is displayed on the whole display area of the display 110when the controller 120 executes a run management application. As shownin FIG. 55, the whole execution screen (e.g., including phases 5510,5520, and 5530) is larger than the visible area. Accordingly, thecontroller 120 may display the execution screen in phases (e.g. phases5510, 5520, and 5530) according to a user interaction.

FIGS. 56A, 56B, and 56C are views illustrating a method for changing ascreen displayed on a visible area and an example of an execution screendisplayed in the visible area accordingly according to an embodiment ofthe present disclosure.

Referring to FIG. 56A, a middle part 5520 of the execution screen ofFIG. 55 is displayed in the visible area. Referring to FIG. 56A,distance that the user has run, elapsed time, speed graph, variousmenus, and the like may be displayed. According to various embodimentsof the present disclosure, a part of the upper part 5510 of theexecution screen is displayed on an upper end of the visible area, and apart of the lower part 5530 of the execution screen is displayed on alower end of the visible area.

In this state, when the user performs a first user interaction, theupper part 5510 moves down and is displayed in the visible area as shownin FIG. 56B. The upper part 5510 may display information on runninghistory of friends of the user. In contrast, when the user performs asecond user interaction, the lower part 5530 moves up and is displayedin the visible area as shown in FIG. 56C. The lower part 5530 of theexecution screen may display information on running course and distance.

FIGS. 57A and 57B are views to illustrate a method for using a runmanagement application according to an embodiment of the presentdisclosure.

Referring to FIGS. 57A and 57B, an execution screen 5520 displaysinformation such as distance that the user has run, elapsed time, andhourly speed, and buttons 5521 and 5522. The user manages the user's ownexercise by pressing the start button 5522 and starting exercising, andpressing the end button 5521 when finishing exercising.

FIGS. 58A to 58G are views to illustrate a method for using a wholeexecution screen of a run management application according to anembodiment of the present disclosure.

Referring to FIGS. 58A to 58G, a visible area out of the whole displayarea of the display 110 is illustrated. FIG. 58A illustrates a middlescreen part 5520 of the execution screen that is displayed in thevisible area. In this state, when the user makes a gesture of rubbingdownwardly or tilting the user's wrist wearing the mobile device to theright, an upper screen part 5510 of the execution screen moves down andis displayed in the visible area as shown in FIG. 48B. A userinteraction to change the screen displayed in the visible area may beset variously. However, in the present embodiment of the presentdisclosure, the screen is set to be changed by the gesture of rubbingdownwardly or tilting the user's wrist wearing the mobile device to theright, or by a gesture of rubbing upwardly or tilting the user's wristwearing the mobile device 100 to the left. For the convenience ofexplanation, the gesture of rubbing downwardly or tilting the user'swrist wearing the mobile device 100 to the right is defined as a firstuser interaction, and the opposing gesture is defined as a second userinteraction.

As shown in FIG. 58B, the upper screen part 5510 may display exerciserecords of persons registered as user's friends in the form of a list.The user may touch and drag the screen. Accordingly, the list displayedon the upper screen part 5510 may be scrolled and exercise records ofother persons may be displayed as shown in FIG. 58C.

In this state, when the second user interaction is performed, the screenis changed back to the middle screen part 5520 as shown in FIG. 58D. Incontrast, when the middle screen part 5520 is displayed as shown in FIG.58A or 58D, and the second user interaction is performed, a lower screenpart 5530 is displayed as shown in FIG. 58E. The lower screen part 5530may display running course, distance of the day, and elapsed time. Inaddition, a history menu for viewing previous running records may bedisplayed. When the history menu is selected, previous records aredisplayed as shown in FIG. 58F. When the lower screen part 5530 isdisplayed and the first user interaction is performed, the middle screenpart 5520 is displayed again as shown in FIG. 58G.

In addition, the screen may be changed to another form when the userdoes not see the mobile device.

FIGS. 59A, 59B and 59C illustrate change in the screen when a userlowers a mobile device while the mobile device is executing a runmanagement application according to an embodiment of the presentdisclosure.

Referring to FIGS. 59A, 59B, and 59C, as an example, when the middlescreen part 5520 of the whole execution screen of the run managementapplication is displayed as shown in FIG. 59A, and when the user lowersthe user's hand wearing the mobile device 100 as shown in FIG. 59B, thescreen is changed as shown in FIG. 59C. FIG. 59C illustrates a runningsituation as a histogram image 5900. By providing vibration and visualfeedback, the mobile device 100 can allow the user to know a currentpace intuitively while running. It is determined whether the user lowersthe user's hand or not using the motion sensor 140.

According to various embodiments of the present disclosure, when anevent other than the user interaction occurs, the screen may be changed.

FIGS. 60A, 60B, and 60C are views to illustrate displaying informationon the behavior of others according to an embodiment of the presentdisclosure.

Referring to FIGS. 60A, 60B, and 60C, when the middle screen part 5520of the execution screen of the run management application is displayedas shown in FIG. 60A, and running of another person registered at themobile device 100 finishes or another person sets a record, the upperscreen part 5510 moves down as shown in FIG. 60B and information on therelated person is spread. When a predetermined time (e.g., 3 seconds)elapses, the original screen 5520 is displayed again as shown in FIG.60C even if there is no extra user interaction. The information relatedto other persons may be provided by a server apparatus communicatingwith the mobile device 100. The server apparatus may be implemented invarious forms such as a web server, a cloud server, and the like.Although the information on the friends of the user is automaticallynotified in FIGS. 60A, 60B, and 60C, the information on the friends maybe notified in various ways. For example, when the user touches acertain point or a hidden area on the screen shown in FIG. 60A, a screen5530 as shown in FIG. 60B may be displayed. In addition, when the upperscreen part 5510 is displayed first and the user selects one item of thelist, information on the selected person may be displayed.

In addition, a variety of personal information as well as the runningcourse may be displayed by the run management application.

FIGS. 61A, 61B, 61C, 61D, and 61E are views to illustrate a method fordisplaying a screen of a mobile device according to an embodiment of thepresent disclosure.

Referring to FIGS. 61A, 61B, 61C, 61D, and 61E, the screen 5520 isdisplayed and the second user interaction is performed as shown in FIG.61A, the lower screen part 5530 is displayed as shown in FIG. 61B. Asdescribed above, the lower screen part 5530 displays the running courseof the day in the form of a map. According to various embodiments of thepresent disclosure, a menu 5540 indicating a number of photos takenaround the course is displayed on the lower screen part 5530. As shownin FIG. 61C, 5 photos are stored.

When the user selects the menu 5540, thumbnail images 5531 to 5535 ofthe photos are displayed at respective photographing locations of thephotos on the course. In this state, when one thumbnail image 5533 isselected as shown in FIG. 61D, the selected thumbnail image 5533 isenlarged and displayed as shown in FIG. 61E. As described above, the runmanagement application provides various services related to running sothat the user can have an interest in running.

FIG. 62 is a view illustrating a configuration example of an executionscreen of a run management application according to an embodiment of thepresent disclosure.

Referring to FIG. 62, an upper screen part 6210 of the execution screendisplays information like photos of friends, speed in each section,distance, and elapsed time in the form of a list. A middle screen part6220 may display information like distance, duration, average speed,average calorie burned, calorie burned in each section, and a number ofsteps, and menus such as pause, stop, start, and the like. A lowerscreen part 6230 may display a tracking map, a number of photos of theday, a history menu, and the like. The user may manage the runningexercise effectively by changing the screen according to various userinteractions as described above.

FIG. 63 is a view illustrating an execution screen of a fitnessapplication according to an embodiment of the present disclosure.

Referring to FIG. 63, the execution screen of the fitness applicationmay be divided into 3 unit screens. An upper screen part 6310 displaysinformation like icons or photos and names of registered friends, date,an amount of exercise with a goal, time, calorie burned, and the like.

A middle screen part 6320 displays various contents and informationrelated to the user's exercise. Specifically, a target number ofexercise, a target time, moving image/image guide, and exercisestart/end selection menus may be displayed. A lower screen part 6330displays an amount of user's exercise by mapping the amount of exerciseonto the user's body. Specifically, an exercise history menu, an amountof exercise with a goal, time, calorie burned, a body size, a whole bodyimage, and an exercising part of the body are displayed as a graphicimage.

FIGS. 64A, 64B, and 64C are views to illustrate a method for changing anexecution screen such as, for example, the execution screen of FIG. 63according to a user interaction according to an embodiment of thepresent disclosure.

Referring to FIGS. 64A, 64B, and 64C, similar to the other variousembodiments of the present disclosure such as exemplary embodimentsdescribed above, the execution screen may be changed to the upper screenpart according to the second user interaction as illustrated in FIGS.64A and 64B, or may be changed to the lower screen part according to thefirst user interaction as illustrated in FIGS. 64B and 64C.

As described above, the run management service or the fitness servicemay be provided on the mobile device. These applications may beimplemented as a single application such as a health application. Inaddition, these applications may be displayed in the list UI explainedabove in relation to FIGS. 34A, 34B, and 34C.

FIGS. 65A, 65B, 65C, and 65D are views illustrating an example of a listUI in which a variety of application information including a healthapplication is displayed according to an embodiment of the presentdisclosure.

Referring to FIG. 65A, a list UI screen 6500 displays variousapplication items including an execution screen 6510 of a healthapplication. The execution screen 6510 includes a run management menu6511, user information 6512, and a fitness menu 6513.

As shown in FIG. 65B, when the user touches the run management menu6511, a first screen 6520 to manage running exercise is displayed. Incontrast, as shown in FIG. 65C, when the user touches the fitness menu6513, a second screen 6530 to manage fitness exercise is displayed. Asshown in FIG. 65D, when a stop menu of each screen 6520 and 6530 isselected, the original screen 6500 is displayed again.

FIGS. 66A and 66B are views illustrating an example of a screen which isdisplayed while the user is exercising according to an embodiment of thepresent disclosure.

Referring to FIG. 66A, an execution screen 6320 of the fitnessapplication is illustrated. When a start menu of the execution screen6320 is selected, an image 6321 indicating a degree of exercise isdisplayed as shown in FIG. 66B. The image 6321 is divided into aplurality of unit images. The controller 120 changes color or shape ofthe unit image in phases according to the degree of exercise. Forexample, when the user does barbell lift exercise, colors of the unitimages are changed one by one according to a number of lifts.

As described above, the mobile device may execute various applicationsrelated to health, and the execution screen of the application is freelychanged according to characteristics of the mobile device. There arevarious applications that are executed in the mobile device.

FIG. 67 is a view illustrating an example of an execution screen of amusic application according to an embodiment of the present disclosure.

Referring to FIG. 67, the whole execution screen is divided into anupper screen part 6710, a middle screen part 6720, and a lower screenpart 6730. The upper screen part 6710 displays an album list in whichcovers of music albums displayable by the music application are arrangedin the form of a thumbnail image. The middle screen part 6720 displays aplayback screen of a music content. The playback screen displaysinformation like title, singer, and album photo of music being playedback, various menus like shuffle, playback of previous song, playback ofnext song, playback, pause, and repeat playback, and a playback barindicating a playback time and a remaining time, and a current degree ofplayback. The lower screen part 6730 displays a music list that the userselects to play back. Each music item of the music list may displayinformation such as, for example, album photo, music title, singer, andthe like. The music that is currently played back in the music list maybe highlighted.

FIGS. 68A, 68B, 68C, 68D, 68E, 68F, 68G, and 68F are views to illustratea method for manipulating an execution screen of a music applicationaccording to an embodiment of the present disclosure.

Referring to FIG. 68A, an execution screen 6811 of a music applicationmay be displayed in a list UI 6810. When the user touches the executionscreen 6811, the execution screen is changed to a full applicationscreen as shown in FIG. 68B. In this state, when the user performs thesecond user interaction, a music list 6820 is displayed as shown in FIG.68D. A music item that is currently played back in the music list 6820is highlighted. When the user selects another item in the music list6820, a music content of the selected item is played back and thehighlight display is changed as shown in FIG. 68E.

In this state, when the first user interaction is performed, the screenis changed to a playback screen 6830 as shown in FIG. 68F. The playbackscreen 6830 may display an album photo, a title, and the like of a newlyplayed back music content. In this state, when the second userinteraction is performed, an album list screen 6840 is displayed asshown in FIG. 68G.

In contrast, when the user lowers the user's hand wearing the mobiledevice 100, the execution screen may be changed to another form.

FIGS. 69A, 69B, 69C, and 69D are views illustrating a change example ofan execution screen according to an embodiment of the presentdisclosure.

Referring to FIG. 69A, when the playback screen 6830 is displayed andthe user lowers the user's hand as shown in FIG. 69D, an equalizerscreen 6840 is displayed as shown in FIG. 69B. In this state, when theuser makes a gesture of flicking the user's wrist, a next music contentis played back and an equalizer screen 6850 corresponding to the changedmusic content is displayed as shown in FIG. 69C.

As described above, the mobile device may perform various controloperations according to the user interaction performed on the surface ofthe display 110 or the user interaction to move the mobile deviceitself. For example, an unlock operation to change a lock state to anunlock state may also be automatically performed by the userinteraction.

FIGS. 70A, 70B, 70C, and 70D are views illustrating an example of ascreen manipulation method of a mobile device according to an embodimentof the present disclosure. For example, FIGS. 70A, 70B, 70C, and 70D areviews to illustrate a process of performing an unlock operationaccording to a user interaction according to an embodiment of thepresent disclosure.

Referring to FIG. 70A, when the user lowers the user's arm, the mobiledevice operates in a power saving mode or a lock mode. In this state,brief information (e.g., clock information) 6911 may be displayed on ablack screen 6910.

In this state, as shown in FIG. 70B, when the user raises the user'sarm, the controller 120 displays additional information. For example,when the user raises the user's arm, a visual effect is added and avariety of additional information 6921 and 6922 like weather or dateinformation, notification of a received message, a communication state,a battery level, and the like may be displayed in a screen 6920 inaddition to the clock information 6911.

In this state, when the user keeps eyes on the screen, the controller120 identifies the user's eyes. The controller 120 may identify theuser's eyes by photographing the user's face using a plurality ofphotographers as shown in FIG. 50. As shown in FIG. 70C, a predetermined‘a’ second (e.g., ‘a’ is a predetermined number) elapses after theuser's eyes are identified or the user raises the user's arm, thecontroller 120 displays a list UI 6930. Thereafter, the controller 120executes an application corresponding to an application item placed inthe middle of the list UI 6930, and automatically displays an executionscreen in the list UI as shown in FIG. 70D. In FIG. 70D, a photoapplication placed in the middle of the list UI 6930 is executed and anexecution screen thereof is displayed.

The list UI may not be necessarily displayed on the full screen. Thelist UI may be hidden in the display 110 or in an edge of the display110 and may be displayed according to a user interaction.

FIGS. 71A, 71B, and 71C are views to illustrate a method for displayinga UI according to an embodiment of the present disclosure.

Referring to FIG. 71A, a screen 7000 of the mobile device displays afirst guide image 7010 and a second guide image 7020. The first andsecond guide images 7010 and 7020 may be images for intuitivelyinforming the user that hidden UIs (or UIs not otherwise displayed)exist in such directions. In addition, a part of a line UI may be usedas a guide image. In FIGS. 71A, 71B, and 71C, the first and second guideimages are displayed along edges of the screen 7000 in the form of asmall line.

In this state, as shown in FIG. 71B, when the user performs a first userinteraction of touching the screen and then dragging to the right ortilting the user's wrist to the right, a first line UI 7110 isdisplayed. Specifically, when the first user interaction is detected,the controller 120 moves the first guide image 7010 inside the screenand gradually changes the first guide image 7010 to the first line UI7110. In contrast, as shown in FIG. 71C, when the user performs a seconduser interaction of touching the screen and then dragging to the left ortilting the user's wrist to the left, a second line UI 7120 isdisplayed. When the second user interaction is performed in the stateshown in FIG. 71B, the controller 120 makes the first line UI 7110disappear into the edge. The controller 120 moves the second guide image7020 inside the screen and gradually changes the second guide image 7020to the second line UI 7120.

FIGS. 72A, 72B, and 72C are views illustrating an example of a real UIscreen according to an embodiment of the present disclosure.

Referring to FIG. 72A, an execution screen 7000 of a run managementapplication is illustrated. A first guide image 7010 and a second guideimage 7020 are displayed on opposite edges of the execution screen 7000.

In this state, as shown in FIG. 72B, when the first user interaction isperformed, the first guide image 7010 is changed to a first line UI7110. The first line UI 7110 may be a UI for displaying iconscorresponding to applications installed in the mobile device 100. Inaddition, as shown in FIG. 72C, when the second user interaction isperformed, the second guide image 7020 is changed to a second line UI7120. The second line UI 7120 may be a UI for displaying use recordswhich are arranged in chronological sequence. Specifically, the secondline UI 7120 may display messages sent or received by the user, photostaken by the user, SNS message, and the like.

When one icon of the first line UI 7110 is selected, the controller 120directly executes an application corresponding to the selected icon anddisplays an execution screen of the application. In addition, when a userecord item of the second line UI 7120 is touched, the controller 120executes an application corresponding to the touched item and displaysan execution screen of the application.

In FIGS. 71A to 72C, the guide images and the line UIs are usedaltogether. However, the display of the guide images may be omitted. Inaddition, the guide images or the line UIs may be provided on a standbyscreen other than the execution screen of the application.

FIGS. 73A, 73B, and 73C are views to illustrate a method for displayingan application execution screen using a line UI according to anembodiment of the present disclosure.

Referring to FIG. 73A, an example of a standby screen 7300 isillustrated. The standby screen 7300 displays time lines 7301, 7302, and7303 of hour, minute, and second units. The time lines 7301, 7302, and7303 are displayed in a lengthwise direction according to a shape of themobile device, and each time line 7301, 7302, 7303 displays time bymoving blocks one by one as the time elapses. Specifically, the standbyscreen 7300 displays a current time by moving down blocks of the lines7301, 7302, and 7303 of hour, minute, and second as if a second hand isrotated.

When an unlock operation is performed in this state, the time lines ofhour, minute, and second are integrated into a single long time line inthe standby screen 7300, and move and disappear into one side of thescreen. In FIG. 73B, the integrated time line moves to the right of thescreen and is changed to a second guide image 7312.

As shown in FIG. 73B, when the standby screen 7300 disappears, thecontroller 120 displays a home screen 7310. The home screen 7310displays a first guide image 7311 and the second guide image 7312 onopposite edges. In this state, when the user performs a user interactionof touching the screen and then dragging to the right or tilting theuser's wrist wearing the mobile device 100 to the right, the first guideimage 7311 is changed to a first line UI 7320. A plurality of icons 7321to 7325 are displayed on the second line UI 7320. A user may select anicon of the plurality of icons 7321 to 7325 to perform a correspondingfunction (e.g., launch an associated application). As shown in FIG. 73C,the user may identify icons of installed applications by scrolling up ordown the first line UI 7320.

The controller 120 may display a preview screen 7330 on an applicationcorresponding to an icon displayed at a specific location of the firstline UI 7320. In FIG. 73D, a preview screen 7330 of an icon 7323displayed at a middle location of the first line UI 7320 is displayed.When a specific icon is displayed at the middle location for more than apredetermined time or an icon is selected on the first line UI 7320, thecontroller 120 may display an application execution screen of the iconon the full screen.

FIGS. 74A, 74B, 74C, 74D, and 74E are views illustrating a process ofdisplaying a second line UI according to an embodiment of the presentdisclosure.

FIG. 74A illustrates an example of an execution screen 7400 which isdisplayed when a music application in a first line UI 7410 is selected.A second guide image 7402 is displayed on the right edge of theexecution screen 7400 in the form of a thin line. The execution screen7400 may display a music content playback screen and information ofvarious selectable music contents. In this state, when the user performsa user interaction of touching and dragging from the right to the leftor tilting the user's wrist to the left, the second guide image 7402displayed on the right edge moves in as shown in FIG. 74B. The secondguide image 7402 is automatically enlarged so that information can beidentified and is changed to a second line UI 7420 as shown in FIG. 74C,The second line UI 7420 displays information on previously executedapplications and other use records. The controller 120 may displayapplications of similar attributes in the same color. When the userscrolls the second line UI 7420, a content displayed on the second lineUI 7420 is changed as shown in FIGS. 74C and 74D.

In this state, as shown in FIG. 74E, when one piece of information isselected, an application corresponding to the selected information isexecuted and an execution screen 7430 of the application is displayed.In contrast, the screen of the mobile device may be changed according tovarious events other than the user interaction. For example, when amessage such as a mail or text is transmitted from another person, thecontroller 120 may briefly display the received message on the standbyscreen.

FIGS. 75A, 75B, 75C, and 75D are views illustrating a screenconfiguration of a mobile device according to various embodiments of thepresent disclosure.

FIG. 75A illustrates a standby screen 7500. The standby screen 7500displays a second guide image 7502. When a message is received in thisstate, the controller 120 displays the received message 7510 on thestandby screen 7500 as shown in FIG. 75B. As shown in FIG. 75C. When apredetermined time elapses after the message 7510 is displayed, thecontroller 120 moves the message 7510 toward the second guide image 7502while reducing the message 7510. As a result, as shown in FIG. 75D, themessage 7510 completely moves toward the second guide image 7502 anddisappears, and the standby screen 7500 is displayed. In FIGS. 75A, 75B,75C, and 75D, a process in which the message temporarily displayed onthe standby screen 7500 disappears has been described. However, asimilar graphic effect may be provided in various situations. Forexample, when an application being executed is terminated, an executionscreen of the application may disappear into the second guide image 7502as shown in FIGS. 75B to 75D.

FIG. 76 is a flowchart to illustrate a method for displaying a UI of amobile device which provides a line UI according to an embodiment of thepresent disclosure. For example, FIG. 76 is a flowchart to illustrate amethod for displaying a UI of a mobile device according to theembodiments of the present disclosure illustrated in FIGS. 71 to 75according to an embodiment of the present disclosure.

Referring to FIG. 76, at operation S7610, the mobile device displays ascreen.

When the mobile device displays various screens such as a home screen, adesktop screen, an application execution screen, and the like atoperation S7610, the mobile device determines whether a user interactionis detected. The user interaction may include various manipulations suchas touching the screen and dragging or flicking, rotating or tilting abody wearing the mobile device, inputting a voice command, making amotion gesture, pressing a button, and the like. For example, atoperation S7615, the mobile device determines whether a first userinteraction is detected.

When the mobile device determines that a predetermined first userinteraction is detected at operation S7615, the mobile device proceedsto operation S7620 at which the mobile device displays a first line UI.Thereafter, the mobile device proceeds to operation S7625.

In contrast, when the mobile device determines that a first userinteraction is not detected at operation S7615, then the mobile deviceproceeds to operation S7645 at which the mobile device determineswhether a second user interaction is detected.

When the mobile device determines that a predetermined second userinteraction is detected at operation S7645, the mobile device proceedsto operation S7650 at which the mobile device displays a second line UI.Thereafter, the mobile device proceeds to operation S7655.

In the above-described embodiment of the present disclosure, the firstline UI is a UI for displaying an application icon and the second lineUI is an UI for displaying execution record information in chronologicalsequence. However, the first and second line UIs are not limited to suchexamples. For example, the first and second line UIs may be implementedby using various UIs, such as a UI displaying execution recordinformation in chronological sequence, a UI displaying preferredapplication information, and a UI indicating an executable content.

At operation S7625, the mobile device determines whether an icon in afirst line UI is selected.

When the first line UI is displayed and the mobile device determinesthat the user selects one of the icons at operation S7625, the mobiledevice proceeds to operation S7630 at which the mobile device executesan application corresponding to the selected icon. Thereafter, themobile device proceeds to operation S7365.

At operation S7635, the mobile device displays an execution screen ofthe application.

In contrast, when the mobile device determines that an icon in the firstline UI is not selected at operation S7325, then the mobile deviceproceeds to operation S7640 at which the mobile device deletes the firstline UI after a predetermined time elapses.

At operation S7655, the mobile device determines whether an item (e.g.,information) in a second line UI is selected.

When the second line UI is displayed and the mobile device determinesthat the user selects an item (e.g., information) at operation S7655,the mobile device proceeds to operation S7360 at which the mobile deviceexecutes an application corresponding to the selected information.Thereafter, the mobile device proceeds to operation S7635 at which themobile device displays a screen of the application. In this case, theselected information may be directly displayed on an applicationexecution screen.

In contrast, when the mobile device determines that an item (e.g.,information) in the second line UI is not selected at operation S7655,then the mobile device proceeds to operation S7660 at which the mobiledevice deletes the second line UI after a predetermined time elapses.

In the above-described embodiment of the present disclosure, the firstline UI is displayed as an icon UI and the second line UI is displayedas an execution record UI. However, according to various embodiment ofthe present disclosure, the first and second line UIs may be displayeddifferently according to a state of the mobile device at a time when thefirst and second user interactions occur.

For example, when the standby screen or the home screen is displayed andthe first user interaction occurs, the controller 120 displays anapplication icon in the first line UI, and, when the second userinteraction occurs, the controller 120 displays execution recordinformation in the second line UI. In contrast, when a music applicationis executed and the first user interaction occurs, the controller 120may display content information selectable by the user in the first lineUI and display content information that has been previously played backby the user in the second line UI. When a run management application isexecuted, the first line UI may display information on friends and thesecond line UI may display previous running records.

Also, in the above-described various embodiments of the presentdisclosure, the UI of the line type is opened from the left or rightedge. However, the shape and the display direction of the UI are notlimited to this. For example, the UI may be opened from the upper orlower edge or may be expanded from the center.

As described above, the mobile device may provide various UIs suitablefor the bangle shape and the UI may be changed according to a userinteraction suitable for the shape of the mobile device. Accordingly,the user can use various applications effectively while easily carryingthe mobile device.

The configuration of the mobile device according to the variousembodiments of the present disclosure described in relation to FIGS. 52to 76 may be implemented by configurations of the mobile devicedisclosed in the descriptions of FIGS. 1 to 51 or a combination thereof.

For example, the mobile device may include a storage 130, 3320, adisplay 110, 3310 formed on an outer surface of the mobile deviceseamlessly and displaying an execution screen of an application storedin the storage 130, 3320 on a whole display area, a sensor (at least oneof sensors 174 and 140) to detect a user interaction, and a controller120, 3330 to change a part of the screen displayed on a visible area ofthe whole display area in the execution screen according to a userinteraction.

In addition, the mobile device may include a storage 130, 3320 to storea pre-installed application, a sensor (at least one of sensors 174 and140) to detect a user interaction, a display 110, 3310, and a controller120, 3330 to display a first line UI on a first edge of a screen of thedisplay when a first user interaction is detected, and display a secondline UI on a second edge of the screen of the display when a second userinteraction is detected.

In addition, the mobile device may be implemented by using a deviceincluding an overall configuration as explained in FIG. 32.

According to various embodiments of the present disclosure, the controlmethod, the screen display method, and the UI display method may becoded as software and may be stored in a non-transitory computerreadable medium. The non-transitory computer readable medium may beconnected to or mounted in various types of mobile devices as describedabove, and may support the corresponding device to perform theabove-described methods.

The non-transitory computer readable medium refers to a medium thatstores data semi-permanently rather than storing data for a very shorttime, such as a register, a cache, and a memory, and is readable by anapparatus. Specifically, the above-described various applications orprograms may be stored in a non-transitory computer readable medium suchas a compact disc (CD), a Digital Versatile disk (DVD), a hard disk, aBlu-ray disk, a Universal Serial Bus (USB), a memory card, and a ReadOnly Memory (ROM), and may be provided.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

1. A wearable device comprising: a touch display; one or moreprocessors; and a memory storing one or more programs includinginstructions which, when executed by the one or more processors, causethe wearable device to: display, on the touch display, a first circularicon located in a center area of the touch display in a first size and asecond circular icon located outside of the center area of the touchdisplay in a second size smaller than the first size, the first circularicon and the second circular icon corresponding to a first applicationand a second application, respectively, and based on a direction of atouch input received on the touch display, move the first circular iconand the second circular icon on the touch display such that the firstcircular icon is moved to a position located outside of the center areaof the touch display and reduced in size from the first size to thesecond size and the second circular icon is moved to the center area ofthe touch display and enlarged in size from the second size to the firstsize.
 2. The wearable device of claim 1, wherein the first circular iconcomprises a first indicator representing the first application and thesecond circular icon comprises a second indicator representing thesecond application.
 3. The wearable device of claim 1, wherein theinstructions, when executed by the one or more processors, further causethe one or more processors to, based on one of the first circular iconor the second circular icon being selected, control the touch display todisplay information related to an application corresponding to theselected one of the first circular icon or the second circular icon. 4.The wearable device of claim 1, wherein the first circular iconcorresponds to a watch application, and wherein the first circular iconcomprises information regarding a current time.
 5. The wearable deviceof claim 1, wherein the instructions, when executed by the one or moreprocessors, further cause the one or more processors to: while the touchdisplay is in an inactivated state, detect that the wearable device islifted, and based at least in part on the detecting that the wearabledevice is lifted, control the touch display to change from theinactivated state to an activated state.
 6. The wearable device of claim5, wherein the instructions, when executed by the one or moreprocessors, further cause the one or more processors to: while the touchdisplay is in the activated state, detect that the wearable device islowered, and based at least in part on the detecting that the wearabledevice is lowered, control the touch display to change from theactivated state to the inactivated state.
 7. The wearable device ofclaim 1, wherein the touch input comprises a drag input of touching afirst portion of the touch display and moving the touched first portionto a second portion of the touch display.
 8. A method of a wearabledevice comprising a touch display, the method comprising: displaying, onthe touch display, a first circular icon located in a center area of thetouch display in a first size and a second circular icon located outsideof the center area of the touch display in a second size smaller thanthe first size, the first circular icon and the second circular iconcorresponding to a first application and a second application,respectively; and based on a direction of a touch input received on thetouch display, moving the first circular icon and the second circularicon on the touch display such that the first circular icon is moved toa position located outside of the center area of the touch display andreduced in size from the first size to the second size and the secondcircular icon is moved to the center area of the touch display andenlarged in size from the second size to the first size.
 9. The methodof claim 8, wherein the first circular icon comprises a first indicatorrepresenting the first application and the second circular iconcomprises a second indicator representing the second application. 10.The method of claim 8, further comprising, based on one of the firstcircular icon or the second circular icon being selected, displaying, onthe touch display, information related to an application correspondingto the selected one of the first circular icon or the second circularicon.
 11. The method of claim 8, wherein the first circular iconcorresponds to a watch application, and wherein the first circular iconcomprises information regarding a current time.
 12. The method of claim8, further comprising: while the touch display is in an inactivatedstate, detecting that the wearable device is lifted; and based at leastin part on the detecting that the wearable device is lifted, controllingthe touch display to change from the inactivated state to an activatedstate.
 13. The method of claim 12, further comprising: while the touchdisplay is in the activated state, detecting that the wearable device islowered; and based at least in part on the detecting that the wearabledevice is lowered, controlling the touch display to change from theactivated state to the inactivated state.
 14. The method of claim 8,wherein the touch input comprises a drag input of touching a firstportion of the touch display and moving the touched first portion to asecond portion of the touch display.
 15. A non-transitory computerreadable storage medium configured to store one or more computerprograms including instructions which, when executed by one or moreprocessors, cause the one or more processors to: display, on a touchdisplay, a first circular icon located in a center area of the touchdisplay in a first size and a second circular icon located outside ofthe center area of the touch display in a second size smaller than thefirst size, the first circular icon and the second circular iconcorresponding to a first application and a second application,respectively, and based on a direction of a touch input received on thetouch display, move the first circular icon and the second circular iconon the touch display such that the first circular icon is moved to aposition located outside of the center area of the touch display andreduced in size from the first size to the second size and the secondcircular icon is moved to the center area of the touch display andenlarged in size from the second size to the first size.
 16. Thenon-transitory computer readable storage medium of claim 15, wherein thefirst circular icon comprises a first indicator representing the firstapplication and the second circular icon comprises a second indicatorrepresenting the second application.
 17. The non-transitory computerreadable storage medium of claim 15, wherein the instructions, whenexecuted by the one or more processors, further cause the one or moreprocessors to, based on one of the first circular icon or the secondcircular icon being selected, control the touch display to displayinformation related to an application corresponding to the selected oneof the first circular icon or the second circular icon.
 18. Thenon-transitory computer readable storage medium of claim 15, wherein thefirst circular icon corresponds to a watch application, and wherein thefirst circular icon comprises information regarding a current time. 19.The non-transitory computer readable storage medium of claim 15, whereinthe instructions, when executed by the one or more processors, furthercause the one or more processors to: while the touch display is in aninactivated state, detect that a wearable device is lifted; and based atleast in part on the detecting that the wearable device is lifted,control the touch display to change from the inactivated state to anactivated state.
 20. The non-transitory computer readable storage mediumof claim 19, wherein the instructions, when executed by the one or moreprocessors, further cause the one or more processors to: while the touchdisplay is in the activated state, detect that the wearable device islowered; and based at least in part on the detecting that the wearabledevice is lowered, control the touch display to change from theactivated state to the inactivated state.